10/21/2024 02:01:24.692 7f9f91eb6ec8 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/21/2024 02:01:24.693 7f9f91eb6ec8 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/21/2024 02:01:24.693 7f9f91eb6ec8 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/21/2024 02:01:24.693 7f9f895892e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 10/21/2024 02:01:24.693 7f9f895892e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:01:24.694 7f9f895892e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/21/2024 02:01:24.694 7f9f895892e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/21/2024 02:01:24.694 7f9f895892e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.694 7f9f895892e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/21/2024 02:01:24.694 7f9f895892e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.694 7f9f895892e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.694 7f9f895892e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 start_time = 1729476084694183 collector_name = collector_ip = collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/21/2024 02:01:24.695 7f9f895892e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.786 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.30:5673//'] 10/21/2024 02:01:24.798 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 10/21/2024 02:01:24.798 7f9f8955bac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.799 7f9f8955bac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:24.799 7f9f8955bac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.799 7f9f8955bac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.799 7f9f8955bac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:24.799 7f9f8955bac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:28.695 7f9f8ee15438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:33.698 7f9f8ee15438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:33.699 7f9f8ee15438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:33.699 7f9f8ee15438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.699 7f9f8ee15438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:33.699 7f9f8ee15438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.699 7f9f8ee15438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:33.700 7f9f8ee15438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:33.700 7f9f8ee15438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:33.700 7f9f8ee15438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:33.700 7f9f8ee15438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:33.700 7f9f8ee15438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:33.700 7f9f8ee15438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/21/2024 02:01:33.700 7f9f8ee15438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:37.700 7f9f894164e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:42.703 7f9f894164e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:42.703 7f9f894164e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:42.703 7f9f894164e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:42.703 7f9f894164e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:42.703 7f9f894164e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:42.703 7f9f894164e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:42.704 7f9f894164e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:42.704 7f9f894164e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:42.704 7f9f894164e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:42.704 7f9f894164e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:42.704 7f9f894164e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:42.705 7f9f894164e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/21/2024 02:01:42.705 7f9f894164e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:44.838 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 10/21/2024 02:01:44.839 7f9f89398630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:44.839 7f9f89398630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:44.839 7f9f89398630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:44.860 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 10/21/2024 02:01:44.861 7f9f89423240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:44.861 7f9f89423240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:44.861 7f9f89423240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:44.879 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/21/2024 02:01:44.880 7f9f89423240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:44.880 7f9f89423240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:44.880 7f9f89423240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:44.892 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 10/21/2024 02:01:44.892 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 10/21/2024 02:01:44.893 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 10/21/2024 02:01:44.893 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 10/21/2024 02:01:44.894 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 10/21/2024 02:01:44.895 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/21/2024 02:01:44.895 7f9f8955b240 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 10/21/2024 02:01:44.895 7f9f8955b240 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 10/21/2024 02:01:44.896 7f9f89416198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:44.896 7f9f89416198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/21/2024 02:01:44.896 7f9f89416198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:44.897 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 10/21/2024 02:01:44.919 7f9f8955b240 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 10/21/2024 02:01:44.921 7f9f8955ba20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/21/2024 02:01:44.922 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 10/21/2024 02:01:45.257 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 10/21/2024 02:01:45.263 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.264 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 10/21/2024 02:01:45.264 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.268 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 10/21/2024 02:01:45.269 7f9f91e688d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.269 7f9f91e688d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/21/2024 02:01:45.269 7f9f91e688d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.338 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 10/21/2024 02:01:45.409 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 10/21/2024 02:01:45.410 7f9f89337978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.410 7f9f89337978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:45.410 7f9f89337978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.420 7f9f89337f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.421 7f9f89337f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 10/21/2024 02:01:45.421 7f9f89337f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.429 7f9f89284e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.429 7f9f89284e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:45.429 7f9f89284e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.430 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 10/21/2024 02:01:45.430 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 10/21/2024 02:01:45.430 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/21/2024 02:01:45.430 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:45.463 7f9f8955ba20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/21/2024 02:01:45.480 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-juju-os-439-1'] 10/21/2024 02:01:45.493 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/21/2024 02:01:45.527 7f9f8955ba20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/21/2024 02:01:45.562 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-juju-os-439-1'] 10/21/2024 02:01:46.020 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Fetching all containers 10/21/2024 02:01:46.486 7f9f91eb6ec8 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_api_dnsmasq_1 10/21/2024 02:01:46.566 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:46.703 7f9f89295588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:47.225 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-juju-os-439-1.config_queue 10/21/2024 02:01:47.240 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-juju-os-439-1.tftp_queue 10/21/2024 02:01:47.567 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:47.583 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/21/2024 02:01:47.632 7f9f8955ba20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/21/2024 02:01:47.740 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Process 120 prepared to run in Full mode... 10/21/2024 02:01:47.741 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 10/21/2024 02:01:47.741 7f9f91eb6ec8 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 10/21/2024 02:01:47.745 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 10/21/2024 02:01:47.745 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 10/21/2024 02:01:47.746 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 10/21/2024 02:01:47.746 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 10/21/2024 02:01:47.748 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 10/21/2024 02:01:47.748 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 10/21/2024 02:01:47.754 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 10/21/2024 02:01:47.754 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 10/21/2024 02:01:47.754 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 10/21/2024 02:01:47.754 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 10/21/2024 02:01:47.754 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 10/21/2024 02:01:47.754 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 10/21/2024 02:01:47.754 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 10/21/2024 02:01:47.755 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 10/21/2024 02:01:47.756 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 10/21/2024 02:01:47.757 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 10/21/2024 02:01:47.757 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 10/21/2024 02:01:47.757 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 10/21/2024 02:01:47.757 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 10/21/2024 02:01:47.762 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 10/21/2024 02:01:47.762 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 10/21/2024 02:01:47.765 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 10/21/2024 02:01:47.766 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 10/21/2024 02:01:47.766 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 10/21/2024 02:01:47.766 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 10/21/2024 02:01:47.767 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 10/21/2024 02:01:47.769 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 10/21/2024 02:01:47.770 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 10/21/2024 02:01:47.770 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 10/21/2024 02:01:47.770 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 10/21/2024 02:01:47.770 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 10/21/2024 02:01:47.770 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 10/21/2024 02:01:47.771 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 10/21/2024 02:01:47.771 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 10/21/2024 02:01:47.771 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 10/21/2024 02:01:47.772 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 10/21/2024 02:01:47.772 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 10/21/2024 02:01:47.772 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 10/21/2024 02:01:47.772 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 10/21/2024 02:01:47.772 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 10/21/2024 02:01:47.774 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 10/21/2024 02:01:47.774 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 10/21/2024 02:01:47.774 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 10/21/2024 02:01:47.775 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 10/21/2024 02:01:47.775 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 10/21/2024 02:01:47.775 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 10/21/2024 02:01:47.775 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 10/21/2024 02:01:47.785 7f9f91eb6ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 10/21/2024 02:01:47.891 7f9f891fdb70 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 10/21/2024 02:01:47.892 7f9f891fdb70 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 10/21/2024 02:01:47.941 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-juju-os-439-1', 'device_manager_ztp.cn-jenkins-deploy-platform-juju-os-439-1.config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-juju-os-439-1.tftp_queue', 'device_manager_ztp.ztp_queue'] 10/21/2024 02:01:48.143 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/21/2024 02:01:48.165 7f9f8955ba20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/21/2024 02:01:48.184 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-juju-os-439-1', 'device_manager_ztp.cn-jenkins-deploy-platform-juju-os-439-1.config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-juju-os-439-1.tftp_queue', 'device_manager_ztp.ztp_queue'] 10/21/2024 02:01:49.189 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:50.190 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:51.191 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:51.709 7f9f89295588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:51.710 7f9f89295588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:51.710 7f9f89295588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.710 7f9f89295588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:01:51.710 7f9f89295588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.710 7f9f89295588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.710 7f9f89295588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/21/2024 02:01:51.710 7f9f89295588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.710 7f9f89295588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.711 7f9f89295588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:01:51.711 7f9f89295588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.711 7f9f89295588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:51.711 7f9f89295588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:51.711 7f9f89295588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:51.711 7f9f89295588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:51.711 7f9f89295588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:51.712 7f9f89295588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:51.712 7f9f89295588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:01:51.712 7f9f89295588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:52.193 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:53.194 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:54.195 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:55.196 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:55.709 7f9f89398198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:56.197 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:56.298 7f9f8886ecc0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:01:57.200 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:58.202 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:59.203 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:00.205 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:00.713 7f9f89398198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:00.719 7f9f89398198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:00.719 7f9f89398198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.719 7f9f89398198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:00.719 7f9f89398198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.720 7f9f89398198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:00.721 7f9f89398198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:00.721 7f9f89398198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:00.721 7f9f89398198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:00.721 7f9f89398198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:00.721 7f9f89398198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:00.721 7f9f89398198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:02:00.721 7f9f89398198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:01.205 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:02.206 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:03.207 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:04.209 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:04.713 7f9f8efde6d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:05.210 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:06.211 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:07.213 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:08.214 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:09.216 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:09.716 7f9f8efde6d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:09.716 7f9f8efde6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:09.716 7f9f8efde6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:09.716 7f9f8efde6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:09.717 7f9f8efde6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:09.717 7f9f8efde6d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:09.717 7f9f8efde6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:09.717 7f9f8efde6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:09.717 7f9f8efde6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:09.717 7f9f8efde6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:09.718 7f9f8efde6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:09.718 7f9f8efde6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:02:09.718 7f9f8efde6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:10.218 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:11.219 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:12.220 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:13.221 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:13.716 7f9f90d45e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:14.223 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:15.224 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:16.225 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:16.982 7f9f8886bac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:02:17.226 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:18.227 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:18.719 7f9f90d45e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:18.719 7f9f90d45e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:18.719 7f9f90d45e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:18.720 7f9f90d45e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:18.720 7f9f90d45e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:18.720 7f9f90d45e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:18.720 7f9f90d45e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:18.721 7f9f90d45e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:18.721 7f9f90d45e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:18.721 7f9f90d45e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:18.721 7f9f90d45e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:18.722 7f9f90d45e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:02:18.722 7f9f90d45e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:19.228 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:20.229 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:21.231 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:22.231 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:22.719 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:23.233 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:24.235 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:25.236 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:26.237 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:27.238 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:27.726 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:27.727 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:27.727 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:27.727 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:27.727 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:27.727 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:27.728 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:27.728 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:27.728 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:27.728 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:27.728 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:27.728 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:02:27.728 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:28.238 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:29.240 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:30.240 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:31.241 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:31.727 7f9f88866630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:32.243 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:33.243 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:34.244 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:35.246 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:36.247 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:36.729 7f9f88866630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:36.729 7f9f88866630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:36.729 7f9f88866630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:36.729 7f9f88866630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:36.730 7f9f88866630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:36.730 7f9f88866630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:36.730 7f9f88866630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:36.730 7f9f88866630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:36.730 7f9f88866630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:36.731 7f9f88866630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:36.731 7f9f88866630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:36.731 7f9f88866630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:02:36.731 7f9f88866630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:37.248 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:38.249 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:39.250 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:40.251 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:40.729 7f9f8887e198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:41.253 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:42.254 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:43.328 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:44.330 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:45.331 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:45.731 7f9f8887e198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:45.732 7f9f8887e198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:45.732 7f9f8887e198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:45.732 7f9f8887e198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:45.732 7f9f8887e198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:45.732 7f9f8887e198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:45.733 7f9f8887e198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:45.733 7f9f8887e198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:45.733 7f9f8887e198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:45.733 7f9f8887e198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:45.733 7f9f8887e198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:45.733 7f9f8887e198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:02:45.733 7f9f8887e198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:46.333 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:47.335 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:48.336 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:49.336 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:49.732 7f9f8efedac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:50.338 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:50.881 7f9f8886ee10 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:02:51.339 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:52.340 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:53.341 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:54.342 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:54.735 7f9f8efedac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:54.735 7f9f8efedac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:54.735 7f9f8efedac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.736 7f9f8efedac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:54.736 7f9f8efedac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.736 7f9f8efedac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:54.736 7f9f8efedac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:54.736 7f9f8efedac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:54.737 7f9f8efedac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:54.737 7f9f8efedac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:54.737 7f9f8efedac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:54.737 7f9f8efedac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:02:54.737 7f9f8efedac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:55.343 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:56.344 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:57.345 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:58.346 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:58.735 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:59.349 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:59.585 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 10/21/2024 02:02:59.586 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 10/21/2024 02:02:59.586 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 10/21/2024 02:02:59.587 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 10/21/2024 02:02:59.652 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 10/21/2024 02:02:59.659 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 10/21/2024 02:02:59.680 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:02:59.757 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 10/21/2024 02:02:59.761 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:02:59.767 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:02:59.834 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 10/21/2024 02:02:59.837 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:02:59.837 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 10/21/2024 02:02:59.946 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 10/21/2024 02:02:59.955 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:03:00.119 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 10/21/2024 02:03:00.125 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:03:00.131 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:03:00.217 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 10/21/2024 02:03:00.223 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:03:00.229 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:03:00.343 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 10/21/2024 02:03:00.346 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:03:00.349 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:00.351 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:03:00.447 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 10/21/2024 02:03:00.452 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:03:00.460 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:03:00.590 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 10/21/2024 02:03:00.593 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:03:00.599 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:03:00.681 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 10/21/2024 02:03:00.685 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:03:00.692 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:03:00.844 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 10/21/2024 02:03:00.847 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:03:00.852 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:03:00.934 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 10/21/2024 02:03:00.938 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/21/2024 02:03:00.973 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.30:5673//'] 10/21/2024 02:03:00.973 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 10/21/2024 02:03:00.995 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 10/21/2024 02:03:01.009 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 10/21/2024 02:03:01.059 7f9f91eb6ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/21/2024 02:03:01.060 7f9f887a0f60 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 10/21/2024 02:03:01.125 7f9f887a0f60 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/21/2024 02:03:01.351 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:02.353 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:03.354 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:03.738 7f9f888666d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:03.741 7f9f888666d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:03.742 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.742 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:03.742 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.742 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.742 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/21/2024 02:03:03.742 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.742 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.742 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 10/21/2024 02:03:03.742 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.743 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:03.744 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.745 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.745 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:03:03.745 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.745 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.745 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:03.745 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.745 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:03.746 7f9f888666d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:03.746 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:03.746 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:03.746 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:03.746 7f9f888666d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:03.746 7f9f888666d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:03:03.746 7f9f888666d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:04.356 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:05.357 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:05.630 7f9f887ad438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'oper': 'UPDATE', 'request-id': 'req-5a2750f5-3eb2-4961-862b-4c4545eb8eb7', 'type': 'virtual_router', 'uuid': '61c97f74-2765-4063-9c20-f1a4ca57c82c'} 10/21/2024 02:03:05.630 7f9f887ad438 [contrail-device-manager] [ERROR]: Error in rabbitmq drainer greenlet: 'DeviceManagerLogger' object has no attribute 'warn' 10/21/2024 02:03:05.630 7f9f887ad438 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 10/21/2024 02:03:05.631 7f9f88866240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:05.631 7f9f88866240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:03:05.631 7f9f88866240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:05.649 7f9f887ad438 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 10/21/2024 02:03:05.649 7f9f8874cd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:05.650 7f9f8874cd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:05.650 7f9f8874cd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:05.926 7f9f887ad438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-a5e1084f-c198-4f42-95bd-f51b5b9cbf9e', 'type': 'virtual_machine_interface', 'uuid': '62338fc6-1c29-4a80-9c2c-c12c5608156e'} 10/21/2024 02:03:06.359 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:07.360 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:07.739 7f9f891fd978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:08.362 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:09.363 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:10.365 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:11.366 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:12.368 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:12.743 7f9f891fd978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:12.744 7f9f891fd978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:12.744 7f9f891fd978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:12.744 7f9f891fd978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:12.744 7f9f891fd978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:12.745 7f9f891fd978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:12.745 7f9f891fd978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:12.745 7f9f891fd978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:12.746 7f9f891fd978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:12.746 7f9f891fd978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:12.746 7f9f891fd978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:12.746 7f9f891fd978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:03:12.746 7f9f891fd978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:13.370 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:14.372 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:15.374 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:16.375 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:16.744 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:17.376 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:18.378 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:19.379 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:20.380 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:21.382 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:21.746 7f9f89307780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:21.746 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:21.746 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:21.746 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:21.747 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:21.747 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:21.747 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:21.747 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:21.747 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:21.747 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:21.747 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:21.748 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:03:21.748 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:22.001 7f9f89307780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:03:22.383 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:23.385 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:24.386 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:25.387 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:25.747 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:26.390 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:27.391 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:28.392 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:29.394 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:30.395 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:30.749 7f9f89307780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:30.749 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:30.749 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:30.749 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:30.749 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:30.749 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:30.750 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:30.750 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:30.750 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:30.750 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:30.750 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:30.751 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:03:30.751 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:31.397 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:32.398 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:33.400 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:34.402 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:34.749 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:35.403 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:36.145 7f9f887a5ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:03:36.404 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:37.427 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:38.428 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:39.430 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:39.752 7f9f89307780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:39.752 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:39.753 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:39.753 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:39.753 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:39.753 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:39.753 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:39.754 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:39.754 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:39.754 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:39.754 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:39.754 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:03:39.754 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:40.432 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:41.434 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:42.436 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:43.437 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:43.753 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:44.438 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:45.439 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:46.440 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:47.442 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:48.444 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:48.755 7f9f89307780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:48.755 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:48.755 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:48.756 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:48.756 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:48.756 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:48.756 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:48.757 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:48.757 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:48.757 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:48.757 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:48.757 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:03:48.757 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:49.446 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:50.447 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:51.449 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:52.450 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:52.756 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:53.452 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:54.453 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:55.455 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:56.457 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:57.458 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:57.758 7f9f89307780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:57.759 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:57.759 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:57.759 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:57.759 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:57.759 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:57.760 7f9f89307780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:57.760 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:57.760 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:57.760 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:57.761 7f9f89307780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:57.761 7f9f89307780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:03:57.761 7f9f89307780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:58.460 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:59.462 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:00.464 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:01.465 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:01.759 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:02.467 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:03.469 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:04.470 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:05.472 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:06.474 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:06.761 7f9f887a0978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:06.761 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:06.761 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:06.761 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:06.761 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:06.761 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:06.762 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:06.762 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:06.762 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:06.762 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:06.762 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:06.762 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:04:06.762 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:07.475 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:08.476 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:09.477 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:10.479 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:10.762 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:11.481 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:12.482 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:13.484 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:14.486 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:15.488 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:15.763 7f9f887a0978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:15.764 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:15.764 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:15.764 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:15.764 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:15.764 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:15.765 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:15.765 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:15.765 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:15.765 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:15.765 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:15.765 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:04:15.765 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:16.489 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:17.491 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:18.493 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:19.494 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:19.764 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:20.496 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:21.498 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:22.499 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:23.500 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:24.502 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:24.767 7f9f887a0978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:24.767 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:24.767 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:24.767 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:24.768 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:24.768 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:24.768 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:24.768 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:24.768 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:24.768 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:24.769 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:24.769 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:04:24.769 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:25.504 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:26.505 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:27.507 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:28.509 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:28.767 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:29.511 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:30.512 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:31.514 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:32.515 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:33.516 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:33.769 7f9f887a0978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:33.770 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:33.770 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:33.770 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:33.770 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:33.770 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:33.771 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:33.771 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:33.772 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:33.772 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:33.772 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:33.772 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:04:33.772 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:34.518 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:35.520 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:36.522 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:37.523 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:37.770 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:38.524 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:39.527 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:40.527 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:41.529 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:42.530 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:42.772 7f9f887a0978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:42.773 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:42.773 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:42.773 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:42.773 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:42.773 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:42.774 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:42.774 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:42.774 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:42.774 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:42.774 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:42.774 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:04:42.774 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:43.532 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:44.533 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:45.535 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:46.537 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:46.773 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:47.539 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:48.541 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:49.542 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:50.543 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:51.545 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:51.774 7f9f887a0978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:51.775 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:51.775 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:51.775 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:51.775 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:51.775 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:51.776 7f9f887a0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:51.776 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:51.776 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:51.776 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:51.776 7f9f887a0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:51.776 7f9f887a0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:04:51.776 7f9f887a0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:52.546 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:53.548 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:54.549 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:55.171 7f9f8ee3c0f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:04:55.551 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:55.775 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:56.553 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:57.555 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:58.556 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:59.558 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:00.560 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:00.778 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:00.778 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:00.778 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:00.779 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:00.779 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:00.779 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:00.780 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:00.780 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:00.780 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:00.780 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:00.781 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:00.781 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:05:00.781 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:01.561 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:02.562 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:03.564 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:04.566 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:04.779 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:05.567 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:06.569 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:07.570 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:08.572 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:09.573 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:09.781 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:09.782 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:09.782 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:09.782 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:09.782 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:09.782 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:09.783 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:09.783 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:09.783 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:09.783 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:09.783 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:09.783 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:05:09.783 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:10.434 7f9f8ee3c0f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:05:10.575 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:11.577 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:12.578 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:13.580 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:13.782 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:14.581 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:15.582 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:16.584 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:17.586 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:18.588 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:18.784 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:18.784 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:18.784 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:18.784 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:18.784 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:18.784 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:18.785 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:18.785 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:18.785 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:18.785 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:18.786 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:18.786 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:05:18.786 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:19.590 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:20.592 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:21.594 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:22.595 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:22.784 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:23.597 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:24.513 7f9f88746c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:05:24.598 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:25.600 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:26.601 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:27.603 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:27.787 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:27.787 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:27.787 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:27.787 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:27.788 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:27.788 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:27.788 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:27.788 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:27.789 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:27.789 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:27.789 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:27.789 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:05:27.789 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:28.604 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:29.606 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:30.607 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:31.608 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:31.787 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:32.610 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:33.613 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:34.614 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:35.616 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:36.618 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:36.789 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:36.789 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:36.789 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:36.789 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:36.789 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:36.789 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:36.790 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:36.790 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:36.790 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:36.790 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:36.790 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:36.791 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:05:36.791 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:37.620 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:38.622 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:39.623 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:40.641 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:40.790 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:41.643 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:42.644 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:43.645 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:44.647 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:45.648 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:45.792 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:45.792 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:45.793 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:45.793 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:45.793 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:45.793 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:45.794 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:45.794 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:45.794 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:45.794 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:45.794 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:45.794 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:05:45.794 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:46.650 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:47.652 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:48.654 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:49.656 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:49.792 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:50.658 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:51.659 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:51.726 7f9f887ad438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'oper': 'UPDATE', 'request-id': 'req-4b3ea080-434c-4c03-931f-6554d756dcea', 'type': 'bgp_router', 'uuid': '6595929d-71c1-408c-9fc5-f5862213e5f7'} 10/21/2024 02:05:52.660 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:53.409 7f9f8874ccc0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:05:53.661 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:54.663 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:54.794 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:54.794 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:54.794 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:54.795 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:54.795 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:54.795 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:54.795 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:54.795 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:54.796 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:54.796 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:54.796 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:54.796 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:05:54.796 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:55.664 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:56.665 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:57.667 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:58.670 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:58.795 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:59.671 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:00.673 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:01.674 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:02.677 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:03.677 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:03.796 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:03.797 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:03.799 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:03.799 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:03.800 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:03.800 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:03.800 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:03.800 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:03.800 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:03.801 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:03.802 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:03.802 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:06:03.802 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:04.680 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:05.684 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:06.690 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:07.692 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:07.799 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:08.693 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:09.697 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:10.699 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:11.702 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:12.703 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:12.801 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:12.801 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:12.801 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:12.802 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:12.802 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:12.802 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:12.802 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:12.803 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:12.803 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:12.803 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:12.803 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:12.803 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:06:12.804 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:13.705 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:14.707 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:15.708 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:16.710 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:16.801 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:17.713 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:18.714 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:19.716 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:20.718 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:21.720 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:21.803 7f9f887b1e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:21.803 7f9f887b1e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:21.803 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:21.804 7f9f887b1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:21.804 7f9f887b1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:21.804 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:21.805 7f9f887b1e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:21.805 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:21.805 7f9f887b1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:21.805 7f9f887b1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:21.805 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:21.806 7f9f887b1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:06:21.806 7f9f887b1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:22.722 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:23.724 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:24.725 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:25.727 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:25.803 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:26.729 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:27.730 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:28.732 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:29.733 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:30.734 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:30.806 7f9f887b1e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:30.806 7f9f887b1e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:30.806 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:30.807 7f9f887b1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:30.807 7f9f887b1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:30.807 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:30.808 7f9f887b1e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:30.808 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:30.808 7f9f887b1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:30.808 7f9f887b1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:30.808 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:30.808 7f9f887b1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:06:30.808 7f9f887b1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:31.736 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:32.737 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:33.738 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:34.739 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:34.807 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:35.741 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:36.742 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:37.744 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:38.745 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:39.746 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:39.809 7f9f887b1e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:39.863 7f9f887b1e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:39.863 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:39.864 7f9f887b1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:39.864 7f9f887b1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:39.864 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:39.864 7f9f887b1e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:39.864 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:39.864 7f9f887b1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:39.865 7f9f887b1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:39.865 7f9f887b1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:39.865 7f9f887b1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:06:39.865 7f9f887b1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:40.748 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:41.750 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:42.750 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:43.752 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:43.865 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:44.754 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:45.756 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:46.757 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:47.758 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:48.759 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:48.867 7f9f894648d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:48.867 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:48.868 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:48.869 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:48.869 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:48.869 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:48.869 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:48.869 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:48.870 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:48.870 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:48.870 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:48.870 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:06:48.870 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:49.761 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:50.763 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:51.764 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:52.766 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:52.868 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:53.768 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:54.770 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:55.771 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:56.773 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:57.774 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:57.870 7f9f894648d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:57.871 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:57.871 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:57.871 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:57.871 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:57.871 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:57.872 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:57.872 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:57.872 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:57.872 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:57.872 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:57.872 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:06:57.872 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:58.776 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:59.778 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:00.779 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:01.779 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:01.871 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:02.781 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:03.783 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:04.785 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:05.786 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:06.787 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:06.873 7f9f894648d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:06.873 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:06.873 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:06.873 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:06.874 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:06.874 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:06.874 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:06.874 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:06.875 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:06.875 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:06.875 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:06.875 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:07:06.875 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:07.789 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:08.790 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:09.790 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:10.792 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:10.873 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:11.794 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:12.795 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:13.796 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:14.798 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:15.799 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:15.876 7f9f894648d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:15.876 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:15.876 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:15.876 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:15.876 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:15.876 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:15.877 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:15.877 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:15.877 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:15.877 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:15.877 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:15.878 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:07:15.878 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:16.800 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:17.802 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:18.803 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:19.804 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:19.876 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:20.806 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:21.807 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:22.809 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:23.811 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:24.812 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:24.879 7f9f894648d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:24.879 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:24.879 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:24.879 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:24.879 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:24.879 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:24.880 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:24.880 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:24.880 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:24.880 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:24.880 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:24.881 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:07:24.881 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:25.814 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:26.815 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:27.817 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:28.818 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:28.879 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:29.820 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:30.820 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:31.822 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:32.824 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:33.824 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:33.881 7f9f894648d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:33.881 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:33.882 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:33.882 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:33.882 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:33.882 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:33.883 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:33.883 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:33.883 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:33.883 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:33.883 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:33.883 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:07:33.883 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:34.827 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:35.828 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:36.829 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:37.831 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:37.881 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:38.833 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:39.834 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:40.836 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:41.837 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:42.839 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:42.883 7f9f894648d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:42.884 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:42.884 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:42.884 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:42.884 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:42.884 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:42.885 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:42.885 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:42.885 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:42.885 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:42.885 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:42.885 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:07:42.885 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:43.840 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:44.842 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:45.843 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:46.845 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:46.884 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:47.846 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:48.847 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:49.849 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:50.850 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:51.852 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:51.885 7f9f894648d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:51.886 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:51.886 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:51.886 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:51.887 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:51.887 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:51.888 7f9f894648d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:51.888 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:51.888 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:51.888 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:51.888 7f9f894648d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:51.888 7f9f894648d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:07:51.889 7f9f894648d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:52.854 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:53.855 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:54.857 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:55.858 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:55.886 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:56.860 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:57.861 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:58.862 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:59.864 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:00.865 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:00.888 7f9f892840f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:00.888 7f9f892840f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:00.888 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:00.889 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:00.889 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:00.889 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:00.889 7f9f892840f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:00.889 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:00.890 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:00.890 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:00.890 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:00.890 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:08:00.890 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:01.867 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:02.869 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:03.870 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:04.872 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:04.888 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:05.873 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:06.874 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:07.876 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:08.877 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:09.879 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:09.891 7f9f892840f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:09.891 7f9f892840f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:09.891 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:09.891 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:09.892 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:09.892 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:09.892 7f9f892840f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:09.892 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:09.893 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:09.893 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:09.893 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:09.893 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:08:09.893 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:10.881 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:11.882 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:12.884 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:13.885 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:13.891 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:14.886 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:15.887 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:16.888 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:17.890 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:18.891 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:18.893 7f9f892840f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:18.894 7f9f892840f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:18.894 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:18.894 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:18.894 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:18.894 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:18.895 7f9f892840f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:18.895 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:18.895 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:18.895 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:18.895 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:18.895 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:08:18.895 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:19.893 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:20.894 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:21.895 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:22.895 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:22.896 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:23.898 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:24.899 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:25.900 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:26.902 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:27.898 7f9f892840f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:27.898 7f9f892840f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:27.898 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:27.898 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:27.898 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:27.898 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:27.899 7f9f892840f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:27.899 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:27.899 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:27.899 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:27.899 7f9f892840f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:27.900 7f9f892840f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:08:27.900 7f9f892840f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:27.903 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:28.905 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:29.906 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:30.907 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:31.899 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:31.908 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:32.909 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:33.911 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:34.912 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:35.913 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:36.901 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:36.901 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:36.901 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:36.902 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:36.902 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:36.902 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:36.902 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:36.902 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:36.903 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:36.903 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:36.903 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:36.903 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:08:36.903 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:36.915 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:37.916 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:38.917 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:39.918 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:40.902 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:40.919 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:41.920 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:42.921 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:43.923 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:44.924 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:45.904 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:45.904 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:45.904 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:45.904 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:45.905 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:45.905 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:45.905 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:45.905 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:45.905 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:45.905 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:45.905 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:45.906 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:08:45.906 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:45.926 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:46.928 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:47.929 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:48.930 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:49.905 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:49.931 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:50.932 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:51.933 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:52.934 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:53.936 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:54.907 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:54.907 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:54.907 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:54.908 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:54.908 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:54.908 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:54.908 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:54.908 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:54.909 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:54.909 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:54.909 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:54.909 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:08:54.909 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:54.936 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:55.938 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:56.939 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:57.941 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:58.533 7f9f887b1240 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:08:58.908 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:58.942 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:59.943 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:00.945 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:01.946 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:02.947 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:03.910 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:03.910 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:03.910 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:03.910 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:03.910 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:03.910 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:03.911 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:03.911 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:03.911 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:03.911 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:03.911 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:03.911 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:09:03.911 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:03.948 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:04.949 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:05.950 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:06.951 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:07.911 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:07.953 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:08.955 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:09.957 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:10.958 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:11.959 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:12.433 7f9f888b7c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:09:12.913 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:12.913 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:12.913 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:12.914 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:12.914 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:12.914 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:12.914 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:12.914 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:12.915 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:12.915 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:12.915 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:12.915 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:09:12.915 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:12.960 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:13.962 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:14.964 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:15.965 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:16.914 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:16.967 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:17.968 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:18.969 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:19.970 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:20.972 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:21.916 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:21.916 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:21.916 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:21.917 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:21.917 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:21.917 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:21.917 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:21.917 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:21.918 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:21.918 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:21.918 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:21.918 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:09:21.918 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:21.973 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:22.975 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:23.976 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:24.978 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:25.917 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:25.979 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:26.981 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:27.982 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:28.983 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:29.433 7f9f8887e390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:09:29.985 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:30.919 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:30.919 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:30.919 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:30.919 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:30.920 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:30.920 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:30.920 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:30.920 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:30.920 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:30.921 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:30.921 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:30.921 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:09:30.921 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:30.986 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:31.987 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:32.989 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:33.990 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:34.919 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:34.991 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:35.993 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:36.994 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:37.995 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:38.996 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:39.921 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:39.921 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:39.922 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:39.922 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:39.922 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:39.922 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:39.922 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:39.922 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:39.923 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:39.923 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:39.923 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:39.923 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:09:39.923 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:39.997 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:40.998 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:42.000 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:43.002 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:43.922 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:44.003 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:45.005 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:46.006 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:47.007 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:48.009 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:48.924 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:48.924 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:48.924 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:48.925 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:48.925 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:48.925 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:48.925 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:48.925 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:48.925 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:48.925 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:48.926 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:48.926 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:09:48.926 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:49.009 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:50.010 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:51.012 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:52.013 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:52.925 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:53.015 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:54.016 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:54.253 7f9f887ffd68 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:09:55.017 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:56.019 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:57.020 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:57.927 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:57.927 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:57.927 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:57.928 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:57.928 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:57.928 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:57.928 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:57.931 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:57.931 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:57.931 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:57.931 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:57.931 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:09:57.931 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:58.021 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:59.022 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:00.024 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:01.026 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:01.928 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:02.027 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:03.028 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:04.029 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:05.030 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:06.032 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:06.931 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:06.931 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:06.931 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:06.931 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:06.932 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:06.932 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:06.932 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:06.933 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:06.933 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:06.933 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:06.933 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:06.933 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:10:06.934 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:07.033 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:08.035 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:09.036 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:10.038 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:10.933 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:11.039 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:12.041 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:13.042 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:14.043 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:15.045 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:15.934 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:15.935 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:15.935 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:15.935 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:15.935 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:15.935 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:15.936 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:15.936 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:15.936 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:15.936 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:15.936 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:15.936 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:10:15.937 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:16.046 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:17.048 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:18.049 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:19.050 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:19.935 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:20.052 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:21.053 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:22.054 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:23.055 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:24.057 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:24.937 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:24.938 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:24.938 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:24.938 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:24.938 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:24.938 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:24.939 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:24.939 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:24.939 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:24.939 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:24.940 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:24.940 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:10:24.940 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:25.058 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:26.060 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:27.061 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:28.062 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:28.939 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:29.063 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:30.065 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:31.067 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:32.068 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:33.070 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:33.940 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:33.941 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:33.941 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:33.941 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:33.941 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:33.941 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:33.942 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:33.942 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:33.942 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:33.942 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:33.942 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:33.942 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:10:33.942 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:34.071 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:35.073 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:36.074 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:37.075 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:37.942 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:38.077 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:39.078 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:40.079 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:41.082 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:42.083 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:42.944 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:42.944 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:42.944 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:42.945 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:42.945 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:42.945 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:42.945 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:42.945 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:42.945 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:42.946 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:42.946 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:42.946 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:10:42.946 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:43.085 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:44.086 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:45.088 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:46.090 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:46.945 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:47.091 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:48.093 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:49.094 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:50.096 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:51.097 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:51.948 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:51.948 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:51.948 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:51.949 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:51.949 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:51.949 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:51.949 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:51.950 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:51.950 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:51.950 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:51.950 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:51.950 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:10:51.950 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:52.099 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:53.100 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:54.102 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:55.104 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:55.949 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:56.105 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:57.106 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:58.107 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:59.108 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:00.110 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:00.951 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:00.952 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:00.952 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:00.952 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:00.952 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:00.952 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:00.953 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:00.953 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:00.953 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:00.953 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:00.953 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:00.954 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:11:00.954 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:01.111 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:02.113 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:03.114 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:04.116 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:04.952 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:05.117 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:06.119 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:07.120 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:08.122 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:09.124 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:09.954 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:09.955 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:09.955 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:09.955 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:09.955 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:09.955 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:09.956 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:09.956 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:09.956 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:09.956 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:09.957 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:09.957 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:11:09.957 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:10.125 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:11.126 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:12.128 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:13.129 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:13.956 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:14.130 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:15.131 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:16.132 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:17.133 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:18.135 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:18.960 7f9f89306588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:18.960 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:18.960 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:18.960 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:18.960 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:18.960 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:18.961 7f9f89306588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:18.961 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:18.961 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:18.961 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:18.961 7f9f89306588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:18.961 7f9f89306588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:11:18.961 7f9f89306588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:19.136 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:20.138 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:21.139 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:22.140 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:22.961 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:23.142 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:24.143 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:25.144 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:26.146 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:27.147 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:27.963 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:27.963 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:27.963 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:27.964 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:27.964 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:27.964 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:27.965 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:27.966 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:27.966 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:27.966 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:27.966 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:27.966 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:11:27.966 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:28.148 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:29.149 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:30.150 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:31.151 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:31.964 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:32.153 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:33.154 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:34.155 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:35.157 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:36.158 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:36.966 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:36.966 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:36.966 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:36.966 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:36.966 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:36.966 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:36.967 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:36.967 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:36.967 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:36.967 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:36.967 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:36.967 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:11:36.968 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:37.159 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:38.161 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:39.162 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:40.163 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:40.976 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:41.165 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:42.168 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:43.170 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:44.173 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:45.175 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:45.982 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:45.982 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:45.983 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:45.983 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:45.983 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:45.983 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:45.983 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:45.984 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:45.984 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:45.984 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:45.984 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:45.984 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:11:45.984 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:46.179 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:47.181 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:48.182 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:49.183 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:49.983 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:50.185 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:51.190 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:52.192 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:53.194 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:54.195 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:54.985 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:54.986 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:54.986 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:54.987 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:54.987 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:54.987 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:54.987 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:54.988 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:54.988 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:54.988 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:54.988 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:54.988 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:11:54.988 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:55.197 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:56.199 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:57.201 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:58.202 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:58.986 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:59.203 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:00.205 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:01.206 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:02.207 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:03.209 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:03.989 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:03.989 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:03.989 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:03.989 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:03.989 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:03.989 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:03.990 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:03.990 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:03.990 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:03.990 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:03.990 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:03.990 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:12:03.990 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:04.210 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:05.212 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:06.213 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:07.214 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:07.989 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:08.216 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:09.218 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:10.220 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:11.221 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:12.222 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:12.991 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:12.992 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:12.992 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:12.992 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:12.992 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:12.992 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:12.993 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:12.993 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:12.993 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:12.994 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:12.994 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:12.994 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:12:12.994 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:13.224 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:14.225 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:15.227 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:16.228 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:16.992 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:17.230 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:18.232 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:19.234 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:20.235 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:21.236 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:21.995 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:21.995 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:21.995 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:21.995 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:21.995 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:21.995 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:21.996 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:21.996 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:21.996 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:21.996 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:21.996 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:21.996 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:12:21.996 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:22.237 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:23.238 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:24.240 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:25.241 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:25.995 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:26.242 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:27.243 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:28.244 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:29.246 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:30.248 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:30.997 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:30.998 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:30.998 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:30.998 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:30.998 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:30.998 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:30.998 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:30.999 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:30.999 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:30.999 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:30.999 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:30.999 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:12:30.999 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:31.250 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:32.251 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:33.253 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:34.254 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:34.998 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:35.255 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:36.257 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:37.258 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:38.259 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:39.261 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:40.001 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:40.001 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:40.001 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:40.001 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:40.002 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:40.002 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:40.002 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:40.002 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:40.003 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:40.003 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:40.003 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:40.003 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:12:40.003 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:40.262 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:41.263 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:42.265 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:43.266 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:44.001 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:44.268 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:45.269 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:46.270 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:47.272 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:48.273 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:49.004 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:49.004 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:49.004 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:49.004 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:49.004 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:49.004 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:49.005 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:49.005 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:49.005 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:49.005 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:49.005 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:49.005 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:12:49.005 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:49.274 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:50.276 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:51.278 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:52.279 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:53.005 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:53.281 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:54.282 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:55.284 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:56.285 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:57.287 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:58.007 7f9f8929a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:58.007 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:58.007 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:58.007 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:58.007 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:58.007 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:58.008 7f9f8929a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:58.008 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:58.008 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:58.008 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:58.008 7f9f8929a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:58.008 7f9f8929a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:12:58.009 7f9f8929a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:58.288 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:59.289 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:00.291 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:01.293 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:02.008 7f9f888014e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:02.294 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:03.295 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:04.295 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:05.297 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:06.300 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:07.010 7f9f888014e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:07.010 7f9f888014e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:07.010 7f9f888014e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:07.011 7f9f888014e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:07.011 7f9f888014e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:07.011 7f9f888014e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:07.011 7f9f888014e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:07.011 7f9f888014e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:07.012 7f9f888014e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:07.012 7f9f888014e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:07.012 7f9f888014e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:07.012 7f9f888014e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:13:07.012 7f9f888014e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:07.302 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:08.303 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:09.305 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:09.439 7f9f88863c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:13:10.306 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:11.011 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:11.307 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:12.309 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:13.310 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:14.311 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:15.312 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:16.014 7f9f88863c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:16.014 7f9f88863c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:16.014 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:16.014 7f9f88863c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:16.014 7f9f88863c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:16.014 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:16.015 7f9f88863c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:16.015 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:16.015 7f9f88863c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:16.015 7f9f88863c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:16.015 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:16.015 7f9f88863c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:13:16.015 7f9f88863c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:16.313 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:17.315 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:18.316 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:19.318 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:20.015 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:20.319 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:21.321 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:22.323 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:23.253 7f9f8ef48f60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:13:23.324 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:24.326 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:25.017 7f9f88863c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:25.018 7f9f88863c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:25.018 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:25.018 7f9f88863c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:25.018 7f9f88863c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:25.018 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:25.019 7f9f88863c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:25.019 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:25.019 7f9f88863c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:25.019 7f9f88863c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:25.019 7f9f88863c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:25.019 7f9f88863c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:13:25.019 7f9f88863c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:25.327 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:26.329 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:27.330 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:28.331 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:29.018 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:29.332 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:30.334 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:31.335 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:32.337 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:33.338 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:34.021 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:34.021 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:34.021 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:34.022 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:34.022 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:34.022 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:34.022 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:34.023 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:34.023 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:34.023 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:34.023 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:34.023 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:13:34.023 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:34.339 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:35.341 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:36.342 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:37.343 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:38.021 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:38.345 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:39.347 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:40.348 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:40.409 7f9f8a1a7ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:13:41.350 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:42.350 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:43.024 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:43.024 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:43.024 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:43.025 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:43.025 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:43.025 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:43.026 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:43.026 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:43.026 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:43.026 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:43.026 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:43.026 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:13:43.026 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:43.352 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:44.353 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:45.355 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:46.357 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:47.025 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:47.359 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:48.360 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:49.362 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:50.364 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:51.365 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:52.027 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:52.027 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:52.027 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:52.027 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:52.027 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:52.028 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:52.028 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:52.028 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:52.028 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:52.029 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:52.029 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:52.029 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:13:52.031 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:52.366 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:53.367 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:54.368 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:55.370 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:56.028 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:56.372 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:57.373 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:58.374 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:59.376 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:00.377 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:01.030 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:01.031 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:01.031 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:01.031 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:01.031 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:01.031 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:01.032 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:01.032 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:01.032 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:01.032 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:01.032 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:01.032 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:14:01.032 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:01.379 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:02.381 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:03.381 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:04.383 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:05.032 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:05.384 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:06.386 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:07.388 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:08.389 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:09.390 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:10.034 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:10.034 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:10.034 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:10.034 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:10.034 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:10.034 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:10.035 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:10.035 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:10.035 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:10.035 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:10.035 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:10.035 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:14:10.035 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:10.392 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:11.394 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:12.396 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:13.397 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:14.034 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:14.398 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:15.399 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:16.400 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:17.401 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:18.402 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:19.036 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:19.036 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:19.036 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:19.037 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:19.037 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:19.037 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:19.037 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:19.037 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:19.037 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:19.038 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:19.038 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:19.038 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:14:19.038 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:19.404 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:20.405 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:21.406 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:22.408 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:23.037 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:23.410 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:24.412 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:25.413 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:26.414 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:27.417 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:28.038 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:28.039 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:28.039 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:28.039 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:28.039 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:28.039 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:28.040 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:28.040 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:28.040 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:28.040 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:28.040 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:28.040 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:14:28.040 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:28.418 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:29.420 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:30.421 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:31.422 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:32.040 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:32.424 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:33.426 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:34.427 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:35.429 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:36.430 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:37.042 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:37.042 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:37.042 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:37.042 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:37.042 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:37.043 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:37.043 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:37.043 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:37.043 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:37.043 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:37.043 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:37.043 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:14:37.044 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:37.431 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:38.433 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:39.434 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:40.435 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:41.043 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:41.437 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:42.438 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:43.440 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:44.442 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:45.443 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:46.044 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:46.045 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:46.045 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:46.045 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:46.045 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:46.045 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:46.046 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:46.046 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:46.046 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:46.046 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:46.046 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:46.046 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:14:46.046 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:46.444 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:47.445 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:48.446 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:49.448 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:50.045 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:50.450 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:51.452 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:52.453 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:53.453 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:54.455 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:55.048 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:55.048 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:55.048 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:55.048 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:55.048 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:55.049 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:55.049 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:55.049 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:55.049 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:55.049 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:55.049 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:55.049 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:14:55.050 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:55.456 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:56.457 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:57.459 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:58.460 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:59.049 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:59.461 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:00.462 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:01.463 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:02.465 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:03.466 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:04.051 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:04.052 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:04.052 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:04.052 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:04.052 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:04.052 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:04.053 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:04.053 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:04.054 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:04.054 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:04.054 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:04.054 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:15:04.054 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:04.467 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:05.469 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:06.470 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:07.472 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:08.052 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:08.474 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:09.475 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:10.476 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:11.478 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:12.479 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:13.055 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:13.055 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:13.055 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:13.056 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:13.056 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:13.056 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:13.056 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:13.057 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:13.057 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:13.057 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:13.057 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:13.057 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:15:13.057 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:13.481 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:14.490 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:15.492 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:16.493 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:17.056 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:17.495 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:18.497 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:19.498 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:20.499 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:21.500 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:22.058 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:22.058 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:22.058 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:22.058 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:22.059 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:22.059 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:22.060 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:22.060 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:22.060 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:22.060 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:22.060 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:22.061 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:15:22.061 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:22.502 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:23.503 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:24.505 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:25.516 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:26.059 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:26.401 7f9f8934f240 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:15:26.517 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:27.518 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:28.519 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:29.521 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:30.523 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:31.061 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:31.061 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:31.062 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:31.062 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:31.062 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:31.062 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:31.062 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:31.062 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:31.063 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:31.063 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:31.063 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:31.063 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:15:31.063 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:31.524 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:32.525 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:33.527 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:34.529 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:35.062 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:35.531 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:36.532 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:37.534 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:38.535 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:39.537 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:40.063 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:40.064 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:40.064 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:40.064 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:40.064 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:40.064 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:40.065 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:40.065 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:40.065 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:40.065 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:40.065 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:40.065 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:15:40.065 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:40.538 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:41.539 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:42.541 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:43.542 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:44.064 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:44.543 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:45.544 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:46.546 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:47.548 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:48.549 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:49.066 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:49.067 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:49.067 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:49.067 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:49.067 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:49.067 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:49.068 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:49.068 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:49.068 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:49.068 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:49.068 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:49.068 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:15:49.068 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:49.550 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:50.552 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:51.554 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:52.556 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:53.067 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:53.558 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:54.559 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:55.560 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:56.562 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:57.563 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:58.069 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:58.070 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:58.070 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:58.070 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:58.070 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:58.070 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:58.071 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:58.071 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:58.071 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:58.071 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:58.071 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:58.071 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:15:58.071 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:58.564 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:59.565 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:00.567 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:01.568 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:02.070 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:02.570 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:03.571 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:04.573 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:05.574 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:06.575 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:07.072 7f9f8a0fd048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:07.073 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:07.073 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:07.073 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:07.073 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:07.073 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:07.074 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:07.074 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:07.074 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:07.074 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:07.074 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:07.075 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:16:07.075 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:07.577 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:08.579 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:09.580 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:10.582 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:11.073 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:11.584 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:12.585 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:13.587 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:14.589 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:15.591 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:16.075 7f9f8a0fd048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:16.075 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:16.075 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:16.075 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:16.075 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:16.076 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:16.076 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:16.077 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:16.078 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:16.078 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:16.078 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:16.078 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:16:16.078 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:16.593 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:17.594 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:18.596 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:19.597 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:20.075 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:20.599 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:21.601 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:22.602 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:23.603 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:24.605 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:25.078 7f9f8a0fd048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:25.078 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:25.078 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:25.079 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:25.079 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:25.079 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:25.080 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:25.080 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:25.080 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:25.080 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:25.080 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:25.080 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:16:25.081 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:25.606 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:26.607 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:27.609 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:28.611 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:29.079 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:29.613 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:30.614 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:31.616 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:32.617 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:33.618 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:34.080 7f9f8a0fd048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:34.081 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:34.081 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:34.081 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:34.081 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:34.081 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:34.082 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:34.082 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:34.082 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:34.082 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:34.082 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:34.082 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:16:34.082 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:34.619 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:35.621 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:36.622 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:37.624 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:38.081 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:38.625 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:39.626 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:40.628 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:41.629 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:42.631 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:43.084 7f9f8a0fd048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:43.084 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:43.084 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:43.084 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:43.084 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:43.085 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:43.085 7f9f8a0fd048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:43.085 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:43.085 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:43.085 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:43.086 7f9f8a0fd048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:43.086 7f9f8a0fd048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:16:43.086 7f9f8a0fd048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:43.633 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:44.634 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:45.636 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:46.637 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:47.084 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:47.639 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:48.641 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:49.643 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:50.644 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:51.645 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:52.086 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:52.086 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:52.086 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:52.087 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:52.087 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:52.087 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:52.087 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:52.087 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:52.087 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:52.087 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:52.088 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:52.088 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:16:52.088 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:52.647 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:53.648 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:54.649 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:55.651 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:56.087 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:56.653 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:57.654 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:58.656 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:59.658 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:00.659 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:01.089 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:01.089 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:01.089 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:01.090 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:01.090 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:01.090 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:01.090 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:01.090 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:01.091 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:01.091 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:01.091 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:01.091 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:17:01.091 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:01.660 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:02.662 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:03.664 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:04.665 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:05.089 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:05.666 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:06.668 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:07.670 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:08.671 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:09.672 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:10.092 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:10.092 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:10.092 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:10.093 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:10.093 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:10.093 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:10.093 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:10.094 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:10.094 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:10.094 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:10.094 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:10.094 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:17:10.094 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:10.674 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:11.675 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:12.677 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:13.679 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:14.092 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:14.680 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:15.682 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:16.684 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:17.685 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:18.702 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:19.094 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:19.094 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:19.094 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:19.094 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:19.094 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:19.094 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:19.095 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:19.095 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:19.095 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:19.095 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:19.095 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:19.095 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:17:19.095 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:19.633 7f9f893bde10 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:17:19.703 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:20.706 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:21.710 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:22.712 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:23.095 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:23.717 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:24.719 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:25.724 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:26.731 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:27.732 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:28.104 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:28.105 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:28.105 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:28.105 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:28.105 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:28.105 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:28.106 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:28.106 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:28.106 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:28.106 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:28.106 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:28.106 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:17:28.106 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:28.734 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:29.736 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:30.745 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:31.747 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:32.105 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:32.749 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:33.752 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:34.754 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:34.975 7f9f88846eb8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:17:35.756 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:36.757 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:37.108 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:37.108 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:37.108 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:37.108 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:37.108 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:37.108 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:37.109 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:37.109 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:37.109 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:37.109 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:37.110 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:37.110 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:17:37.110 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:37.759 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:38.760 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:39.762 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:40.763 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:41.108 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:41.766 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:42.767 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:43.769 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:44.770 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:45.772 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:46.111 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:46.111 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:46.111 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:46.112 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:46.112 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:46.112 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:46.112 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:46.112 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:46.113 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:46.113 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:46.113 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:46.113 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:17:46.113 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:46.773 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:47.774 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:48.775 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:49.777 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:50.112 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:50.778 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:51.779 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:52.271 7f9f8a1a7438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:17:52.781 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:53.782 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:54.784 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:55.114 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:55.114 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:55.115 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:55.115 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:55.115 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:55.115 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:55.116 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:55.116 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:55.116 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:55.116 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:55.116 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:55.117 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:17:55.117 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:55.786 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:56.787 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:57.788 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:58.790 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:59.115 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:59.791 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:00.793 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:01.794 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:02.795 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:03.797 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:04.117 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:04.118 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:04.118 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:04.118 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:04.118 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:04.118 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:04.119 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:04.119 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:04.119 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:04.120 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:04.120 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:04.120 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:18:04.120 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:04.799 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:05.801 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:06.802 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:07.805 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:08.118 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:08.807 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:09.809 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:10.810 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:11.811 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:12.813 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:13.121 7f9f893bde10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:13.121 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:13.121 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:13.122 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:13.122 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:13.122 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:13.122 7f9f893bde10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:13.122 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:13.123 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:13.123 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:13.123 7f9f893bde10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:13.123 7f9f893bde10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:18:13.123 7f9f893bde10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:13.814 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:14.816 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:15.817 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:16.819 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:17.122 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:17.822 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:18.823 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:19.825 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:20.827 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:21.829 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:22.124 7f9f8934f240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:22.124 7f9f8934f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:22.124 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:22.125 7f9f8934f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:22.125 7f9f8934f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:22.125 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:22.125 7f9f8934f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:22.126 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:22.126 7f9f8934f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:22.126 7f9f8934f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:22.127 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:22.127 7f9f8934f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:18:22.127 7f9f8934f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:22.831 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:23.832 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:24.834 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:25.836 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:26.124 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:26.838 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:27.839 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:28.841 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:29.841 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:30.843 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:31.126 7f9f8934f240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:31.127 7f9f8934f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:31.127 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:31.127 7f9f8934f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:31.127 7f9f8934f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:31.127 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:31.128 7f9f8934f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:31.128 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:31.128 7f9f8934f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:31.128 7f9f8934f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:31.128 7f9f8934f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:31.128 7f9f8934f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:18:31.128 7f9f8934f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:31.845 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:32.846 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:33.847 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:34.849 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:35.127 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:35.851 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:36.852 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:37.854 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:38.856 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:39.857 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:40.129 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:40.129 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:40.129 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:40.129 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:40.129 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:40.130 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:40.130 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:40.130 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:40.130 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:40.131 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:40.131 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:40.131 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:18:40.131 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:40.859 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:41.860 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:42.862 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:43.864 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:44.129 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:44.866 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:45.867 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:46.869 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:47.870 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:48.871 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:49.131 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:49.131 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:49.132 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:49.132 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:49.132 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:49.132 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:49.132 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:49.133 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:49.133 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:49.133 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:49.133 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:49.133 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:18:49.133 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:49.872 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:50.873 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:51.874 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:52.877 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:53.131 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:53.879 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:54.881 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:55.883 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:56.884 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:57.886 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:58.134 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:58.135 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:58.135 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:58.135 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:58.135 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:58.136 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:58.136 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:58.136 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:58.136 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:58.136 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:58.136 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:58.137 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:18:58.137 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:58.888 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:59.889 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:00.890 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:01.892 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:02.134 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:02.893 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:03.894 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:04.896 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:05.897 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:06.899 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:07.136 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:07.136 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:07.137 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:07.137 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:07.137 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:07.137 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:07.137 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:07.137 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:07.138 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:07.138 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:07.139 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:07.139 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:19:07.139 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:07.900 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:08.902 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:09.903 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:10.904 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:11.137 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:11.906 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:12.909 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:13.911 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:14.912 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:15.913 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:16.139 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:16.140 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:16.140 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:16.140 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:16.140 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:16.140 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:16.141 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:16.141 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:16.141 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:16.141 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:16.141 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:16.141 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:19:16.141 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:16.914 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:17.915 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:18.917 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:19.919 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:20.140 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:20.920 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:21.922 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:22.924 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:23.925 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:24.927 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:25.142 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:25.142 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:25.142 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:25.142 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:25.143 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:25.143 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:25.143 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:25.143 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:25.143 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:25.143 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:25.144 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:25.144 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:19:25.144 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:25.928 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:26.929 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:27.929 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:28.931 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:29.143 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:29.932 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:30.934 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:31.936 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:32.938 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:33.939 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:34.145 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:34.145 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:34.145 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:34.146 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:34.146 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:34.146 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:34.146 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:34.146 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:34.146 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:34.147 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:34.147 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:34.147 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:19:34.147 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:34.941 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:35.942 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:36.944 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:37.946 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:38.146 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:38.948 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:39.949 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:40.951 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:41.952 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:42.953 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:43.147 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:43.148 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:43.148 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:43.148 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:43.149 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:43.149 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:43.149 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:43.149 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:43.150 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:43.150 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:43.150 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:43.150 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:19:43.150 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:43.955 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:44.957 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:45.959 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:46.961 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:47.148 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:47.963 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:48.964 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:49.966 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:50.967 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:51.969 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:52.149 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:52.150 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:52.150 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:52.150 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:52.150 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:52.150 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:52.150 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:52.151 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:52.151 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:52.151 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:52.151 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:52.151 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:19:52.151 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:52.971 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:53.973 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:54.974 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:55.975 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:56.150 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:56.977 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:57.979 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:58.981 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:59.983 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:00.985 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:01.152 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:01.153 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:01.153 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:01.153 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:01.153 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:01.153 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:01.154 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:01.154 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:01.154 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:01.155 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:01.155 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:01.155 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:20:01.155 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:01.986 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:02.988 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:03.989 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:04.991 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:05.152 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:05.993 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:06.994 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:07.996 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:08.998 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:09.999 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:10.155 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:10.155 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:10.155 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:10.155 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:10.155 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:10.155 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:10.156 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:10.156 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:10.156 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:10.156 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:10.156 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:10.156 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:20:10.157 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:11.002 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:12.003 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:13.004 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:14.006 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:14.155 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:15.008 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:16.009 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:17.011 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:18.013 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:19.015 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:19.157 7f9f89306f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:19.158 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:19.158 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:19.158 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:19.159 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:19.159 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:19.159 7f9f89306f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:19.159 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:19.160 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:19.160 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:19.160 7f9f89306f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:19.160 7f9f89306f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:20:19.160 7f9f89306f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:20.017 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:21.019 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:22.020 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:23.022 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:23.158 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:24.024 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:25.025 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:26.027 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:27.028 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:28.030 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:28.159 7f9f89308ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:28.159 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:28.160 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:28.160 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:28.160 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:28.160 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:28.161 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:28.161 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:28.161 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:28.161 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:28.161 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:28.161 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:20:28.161 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:29.031 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:30.032 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:31.033 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:32.035 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:32.159 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:33.037 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:34.038 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:35.040 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:36.041 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:37.043 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:37.162 7f9f89308ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:37.162 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:37.162 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:37.163 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:37.163 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:37.163 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:37.163 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:37.163 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:37.163 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:37.164 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:37.164 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:37.164 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:20:37.164 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:38.045 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:39.046 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:40.047 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:41.049 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:41.163 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:42.050 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:43.052 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:44.054 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:45.055 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:46.057 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:46.165 7f9f89308ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:46.165 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:46.165 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:46.165 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:46.166 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:46.166 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:46.166 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:46.166 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:46.166 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:46.167 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:46.167 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:46.167 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:20:46.167 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:47.059 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:48.060 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:49.062 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:50.063 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:50.165 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:51.066 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:52.067 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:53.069 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:54.070 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:55.071 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:55.167 7f9f89308ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:55.168 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:55.168 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:55.168 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:55.168 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:55.168 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:55.169 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:55.169 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:55.169 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:55.169 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:55.169 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:55.169 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:20:55.169 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:56.073 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:57.075 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:58.076 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:59.077 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:59.168 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:00.078 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:01.079 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:02.081 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:03.081 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:04.083 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:04.171 7f9f89308ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:04.171 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:04.171 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:04.171 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:04.171 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:04.171 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:04.172 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:04.172 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:04.172 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:04.172 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:04.172 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:04.172 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:21:04.172 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:05.085 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:06.086 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:07.088 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:08.090 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:08.171 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:09.092 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:10.094 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:11.095 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:12.096 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:13.098 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:13.174 7f9f89308ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:13.174 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:13.174 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:13.174 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:13.174 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:13.174 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:13.175 7f9f89308ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:13.175 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:13.175 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:13.176 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:13.176 7f9f89308ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:13.176 7f9f89308ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:21:13.176 7f9f89308ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:14.099 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:14.617 7f9f89308ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:21:15.099 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:16.101 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:17.102 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:17.174 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:18.105 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:19.106 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:20.108 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:21.109 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:22.111 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:22.176 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:22.177 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:22.177 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:22.177 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:22.177 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:22.178 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:22.179 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:22.179 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:22.179 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:22.179 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:22.179 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:22.179 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:21:22.180 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:23.113 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:24.114 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:25.116 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:26.118 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:26.177 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:27.120 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:28.121 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:29.123 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:30.125 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:31.127 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:31.179 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:31.179 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:31.179 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:31.180 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:31.180 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:31.180 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:31.180 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:31.180 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:31.180 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:31.181 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:31.181 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:31.181 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:21:31.181 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:32.129 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:33.130 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:34.131 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:35.133 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:35.179 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:36.135 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:37.137 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:38.139 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:39.140 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:40.141 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:40.182 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:40.182 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:40.182 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:40.182 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:40.182 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:40.182 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:40.183 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:40.183 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:40.183 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:40.183 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:40.183 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:40.183 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:21:40.183 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:41.143 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:42.144 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:43.145 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:44.146 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:44.182 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:45.147 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:46.149 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:47.151 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:48.152 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:49.152 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:49.185 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:49.185 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:49.185 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:49.185 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:49.185 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:49.186 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:49.186 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:49.186 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:49.187 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:49.187 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:49.187 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:49.187 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:21:49.187 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:50.154 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:51.155 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:52.156 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:53.157 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:53.185 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:54.158 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:55.159 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:56.160 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:57.161 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:58.162 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:58.188 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:58.188 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:58.188 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:58.188 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:58.188 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:58.188 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:58.189 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:58.189 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:58.189 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:58.189 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:58.189 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:58.189 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:21:58.189 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:59.163 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:00.165 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:01.166 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:02.167 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:02.188 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:03.168 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:04.169 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:05.170 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:06.172 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:07.173 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:07.190 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:07.190 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:07.191 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:07.191 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:07.191 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:07.191 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:07.191 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:07.192 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:07.192 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:07.192 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:07.192 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:07.192 7f9f8a1a7b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:22:07.192 7f9f8a1a7b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:08.175 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:09.176 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:10.177 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:11.178 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:11.191 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:12.181 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:13.182 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:14.184 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:15.185 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:16.186 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:16.193 7f9f8933d0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:16.193 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:16.193 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:16.193 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:16.193 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:16.193 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:16.194 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:16.194 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:16.194 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:16.194 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:16.194 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:16.194 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:22:16.195 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:17.187 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:18.189 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:19.190 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:20.192 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:20.193 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:21.193 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:22.194 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:23.196 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:24.197 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:25.195 7f9f8933d0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:25.195 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:25.196 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:25.196 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:25.196 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:25.196 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:25.196 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:25.196 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:25.197 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:25.197 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:25.197 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:25.197 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:22:25.197 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:25.198 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:26.200 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:27.201 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:28.202 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:29.196 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:29.203 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:30.204 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:31.206 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:32.208 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:33.209 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:34.198 7f9f8933d0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:34.198 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:34.198 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:34.199 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:34.199 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:34.199 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:34.199 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:34.199 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:34.200 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:34.200 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:34.200 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:34.200 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:22:34.200 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:34.210 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:35.212 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:36.214 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:37.215 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:38.199 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:38.216 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:39.218 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:40.219 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:41.221 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:42.221 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:43.201 7f9f8933d0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:43.201 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:43.201 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:43.201 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:43.201 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:43.201 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:43.202 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:43.202 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:43.202 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:43.202 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:43.202 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:43.202 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:22:43.203 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:43.223 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:44.225 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:45.225 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:46.227 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:47.201 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:47.228 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:48.230 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:49.231 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:50.232 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:51.234 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:51.685 7f9f8a13df60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:22:52.204 7f9f8933d0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:52.204 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:52.204 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:52.204 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:52.204 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:52.204 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:52.205 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:52.205 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:52.205 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:52.205 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:52.205 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:52.205 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:22:52.205 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:52.235 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:53.236 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:54.237 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:55.238 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:56.205 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:56.240 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:57.241 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:58.243 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:59.245 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:00.246 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:01.207 7f9f8933d0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:01.208 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:01.208 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:01.208 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:01.208 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:01.208 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:01.209 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:01.209 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:01.210 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:01.210 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:01.210 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:01.210 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:23:01.210 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:01.248 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:02.248 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:03.249 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:04.250 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:05.209 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:05.251 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:05.413 7f9f88846eb8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:23:06.253 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:07.254 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:08.256 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:09.258 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:10.210 7f9f8933d0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:10.211 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:10.211 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:10.211 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:10.212 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:10.212 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:10.213 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:10.213 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:10.213 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:10.213 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:10.213 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:10.213 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:23:10.213 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:10.259 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:11.261 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:12.262 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:13.263 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:14.211 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:14.265 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:15.266 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:16.267 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:17.272 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:18.277 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:19.213 7f9f8933d0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:19.214 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:19.214 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:19.214 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:19.214 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:19.214 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:19.215 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:19.215 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:19.215 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:19.215 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:19.215 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:19.215 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:23:19.215 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:19.279 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:20.280 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:21.282 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:22.283 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:23.215 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:23.287 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:24.288 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:25.291 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:26.292 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:27.297 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:28.217 7f9f8933d0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:28.218 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:28.218 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:28.218 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:28.218 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:28.218 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:28.219 7f9f8933d0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:28.219 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:28.219 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:28.219 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:28.220 7f9f8933d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:28.220 7f9f8933d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:23:28.220 7f9f8933d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:28.298 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:29.247 7f9f8933d0f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:23:29.300 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:30.301 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:31.302 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:32.219 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:32.304 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:33.305 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:34.306 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:35.307 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:36.308 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:37.221 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:37.221 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:37.221 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:37.221 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:37.222 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:37.222 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:37.222 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:37.222 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:37.223 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:37.223 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:37.223 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:37.223 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:23:37.223 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:37.308 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:38.310 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:39.311 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:40.312 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:41.221 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:41.314 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:42.315 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:43.316 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:44.317 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:45.318 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:46.223 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:46.223 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:46.224 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:46.224 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:46.224 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:46.224 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:46.225 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:46.225 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:46.225 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:46.225 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:46.225 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:46.225 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:23:46.225 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:46.320 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:47.321 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:48.323 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:49.324 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:50.225 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:50.326 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:51.327 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:52.328 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:53.330 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:54.332 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:55.227 7f9f887b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:55.227 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:55.227 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:55.227 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:55.227 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:55.227 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:55.228 7f9f887b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:55.228 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:55.228 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:55.228 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:55.228 7f9f887b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:55.228 7f9f887b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:23:55.228 7f9f887b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:55.333 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:56.334 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:57.336 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:58.337 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:59.228 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:59.338 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:00.340 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:01.341 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:02.342 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:03.343 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:04.230 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:04.230 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:04.231 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:04.231 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:04.231 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:04.231 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:04.232 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:04.232 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:04.232 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:04.232 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:04.233 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:04.233 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:24:04.233 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:04.344 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:05.346 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:06.348 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:07.349 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:08.232 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:08.350 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:09.352 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:10.353 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:11.355 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:12.356 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:13.233 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:13.233 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:13.233 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:13.234 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:13.234 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:13.234 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:13.234 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:13.234 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:13.234 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:13.234 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:13.235 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:13.235 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:24:13.235 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:13.357 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:14.359 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:15.361 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:16.362 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:17.234 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:17.363 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:18.364 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:19.365 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:20.367 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:21.368 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:22.236 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:22.236 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:22.236 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:22.236 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:22.236 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:22.237 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:22.237 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:22.237 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:22.237 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:22.237 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:22.237 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:22.238 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:24:22.238 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:22.369 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:23.371 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:24.372 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:25.373 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:26.237 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:26.374 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:27.376 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:28.378 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:29.380 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:30.382 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:31.239 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:31.239 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:31.239 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:31.239 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:31.240 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:31.240 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:31.240 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:31.240 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:31.240 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:31.240 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:31.240 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:31.241 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:24:31.241 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:31.383 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:32.384 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:33.385 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:34.386 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:35.241 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:35.388 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:36.388 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:37.389 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:38.391 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:39.393 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:40.243 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:40.243 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:40.243 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:40.244 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:40.244 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:40.244 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:40.244 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:40.244 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:40.244 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:40.244 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:40.245 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:40.245 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:24:40.245 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:40.394 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:41.396 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:42.397 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:43.399 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:44.244 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:44.400 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:45.401 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:46.403 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:47.404 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:48.406 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:49.246 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:49.246 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:49.246 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:49.247 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:49.247 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:49.247 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:49.247 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:49.247 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:49.248 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:49.248 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:49.248 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:49.248 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:24:49.248 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:49.407 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:50.409 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:51.410 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:52.411 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:53.248 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:53.412 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:54.413 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:55.414 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:56.416 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:57.417 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:58.249 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:58.250 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:58.250 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:58.250 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:58.250 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:58.250 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:58.251 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:58.251 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:58.251 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:58.251 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:58.251 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:58.251 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:24:58.251 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:58.418 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:59.419 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:00.420 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:01.422 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:02.250 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:02.423 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:03.425 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:04.426 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:05.427 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:06.429 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:07.253 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:07.253 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:07.253 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:07.254 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:07.254 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:07.254 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:07.255 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:07.255 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:07.255 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:07.255 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:07.255 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:07.255 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:25:07.256 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:07.430 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:08.432 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:09.433 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:10.434 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:11.255 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:11.436 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:12.437 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:13.438 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:14.439 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:15.441 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:16.256 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:16.256 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:16.257 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:16.257 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:16.257 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:16.257 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:16.257 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:16.257 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:16.258 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:16.258 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:16.258 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:16.258 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:25:16.258 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:16.441 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:17.442 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:18.443 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:19.444 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:20.258 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:20.446 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:21.448 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:22.449 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:23.450 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:24.452 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:25.260 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:25.261 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:25.261 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:25.261 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:25.261 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:25.261 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:25.262 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:25.262 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:25.262 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:25.262 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:25.262 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:25.262 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:25:25.262 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:25.453 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:26.454 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:27.455 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:28.456 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:29.261 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:29.457 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:30.459 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:31.460 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:32.462 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:33.462 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:34.264 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:34.264 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:34.264 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:34.265 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:34.265 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:34.265 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:34.266 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:34.266 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:34.266 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:34.266 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:34.266 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:34.267 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:25:34.267 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:34.464 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:35.465 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:36.467 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:37.468 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:38.265 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:38.470 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:39.471 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:40.472 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:41.474 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:42.475 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:43.268 7f9f8eed24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:43.268 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:43.268 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:43.269 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:43.269 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:43.269 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:43.269 7f9f8eed24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:43.269 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:43.269 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:43.270 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:43.270 7f9f8eed24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:43.270 7f9f8eed24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:25:43.270 7f9f8eed24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:43.476 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:44.477 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:45.478 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:46.479 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:47.269 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:47.480 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:48.482 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:49.483 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:50.485 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:51.487 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:52.271 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:52.271 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:52.271 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:52.272 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:52.272 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:52.272 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:52.272 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:52.273 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:52.273 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:52.273 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:52.273 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:52.273 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:25:52.273 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:52.488 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:53.489 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:54.491 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:55.492 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:56.272 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:56.493 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:57.495 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:58.496 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:59.497 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:00.498 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:01.275 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:01.275 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:01.276 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:01.276 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:01.276 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:01.276 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:01.277 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:01.277 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:01.277 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:01.277 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:01.277 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:01.277 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:26:01.277 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:01.500 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:02.502 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:03.503 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:04.505 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:05.276 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:05.506 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:06.508 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:07.509 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:08.510 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:09.511 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:10.278 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:10.278 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:10.278 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:10.279 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:10.279 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:10.279 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:10.279 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:10.279 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:10.280 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:10.280 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:10.280 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:10.280 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:26:10.280 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:10.513 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:11.514 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:12.516 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:13.518 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:14.279 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:14.520 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:15.521 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:16.522 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:17.523 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:18.525 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:19.282 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:19.282 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:19.283 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:19.283 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:19.283 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:19.283 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:19.283 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:19.284 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:19.284 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:19.284 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:19.284 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:19.284 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:26:19.284 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:19.526 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:20.527 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:21.529 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:22.530 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:23.283 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:23.531 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:24.533 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:25.534 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:26.536 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:27.537 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:28.286 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:28.286 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:28.286 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:28.286 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:28.287 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:28.287 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:28.287 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:28.287 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:28.288 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:28.288 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:28.288 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:28.288 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:26:28.288 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:28.539 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:29.540 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:30.542 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:31.543 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:32.287 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:32.544 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:33.545 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:34.546 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:35.547 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:36.548 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:37.290 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:37.290 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:37.290 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:37.290 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:37.290 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:37.290 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:37.291 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:37.291 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:37.291 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:37.291 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:37.291 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:37.291 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:26:37.291 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:37.549 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:38.550 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:39.552 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:40.554 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:41.291 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:41.555 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:42.556 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:43.557 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:44.559 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:45.561 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:46.294 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:46.294 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:46.294 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:46.295 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:46.295 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:46.295 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:46.295 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:46.295 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:46.295 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:46.296 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:46.296 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:46.296 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:26:46.296 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:46.562 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:47.563 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:48.564 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:49.565 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:50.295 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:50.566 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:51.567 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:52.569 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:53.570 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:54.572 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:55.297 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:55.297 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:55.297 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:55.298 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:55.298 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:55.298 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:55.298 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:55.298 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:55.299 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:55.299 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:55.299 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:55.299 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:26:55.299 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:55.573 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:56.575 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:57.577 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:58.578 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:59.298 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:59.580 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:00.582 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:01.583 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:02.585 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:03.586 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:04.300 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:04.300 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:04.301 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:04.301 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:04.301 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:04.301 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:04.301 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:04.301 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:04.302 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:04.302 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:04.302 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:04.302 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:27:04.302 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:04.587 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:05.588 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:06.590 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:07.378 7f9f93cf3240 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:27:07.591 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:08.301 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:08.592 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:09.594 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:10.595 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:11.597 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:12.598 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:13.304 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:13.304 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:13.304 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:13.304 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:13.304 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:13.305 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:13.305 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:13.305 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:13.305 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:13.306 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:13.306 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:13.306 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:27:13.306 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:13.600 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:14.602 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:15.603 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:16.605 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:17.305 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:17.607 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:18.608 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:19.610 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:20.610 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:21.612 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:22.307 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:22.308 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:22.308 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:22.308 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:22.308 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:22.308 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:22.309 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:22.309 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:22.310 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:22.310 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:22.310 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:22.310 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:27:22.310 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:22.613 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:23.615 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:24.617 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:25.618 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:26.308 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:26.619 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:27.620 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:28.621 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:29.623 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:30.625 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:31.311 7f9f93cf3240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:31.311 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:31.311 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:31.311 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:31.311 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:31.312 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:31.312 7f9f93cf3240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:31.312 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:31.313 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:31.313 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:31.313 7f9f93cf3240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:31.313 7f9f93cf3240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:27:31.313 7f9f93cf3240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:31.626 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:32.628 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:33.629 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:34.630 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:35.311 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:35.631 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:36.633 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:37.634 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:38.635 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:39.636 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:40.314 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:40.315 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:40.315 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:40.315 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:40.315 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:40.315 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:40.316 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:40.316 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:40.316 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:40.317 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:40.317 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:40.317 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:27:40.317 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:40.637 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:41.639 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:42.641 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:43.644 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:44.315 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:44.645 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:45.103 7f9f887ffc18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:27:45.646 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:46.648 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:47.650 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:48.651 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:49.317 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:49.317 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:49.317 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:49.318 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:49.318 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:49.318 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:49.318 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:49.318 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:49.319 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:49.319 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:49.319 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:49.319 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:27:49.319 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:49.652 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:50.653 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:51.654 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:52.656 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:53.318 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:53.656 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:54.658 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:55.659 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:56.661 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:57.662 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:58.320 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:58.320 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:58.320 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:58.321 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:58.321 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:58.321 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:58.321 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:58.321 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:58.321 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:58.322 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:58.322 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:58.322 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:27:58.322 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:58.664 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:58.875 7f9f8ee3c0f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:27:59.666 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:00.667 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:01.669 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:02.329 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:02.672 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:03.674 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:04.675 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:05.677 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:06.678 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:07.330 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:07.330 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:07.330 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:07.331 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:07.331 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:07.331 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:07.331 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:07.332 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:07.332 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:07.332 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:07.332 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:07.332 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:28:07.332 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:07.684 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:08.686 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:09.687 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:10.688 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:11.331 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:11.690 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:12.692 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:13.693 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:14.695 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:15.696 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:16.334 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:16.334 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:16.334 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:16.334 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:16.334 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:16.335 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:16.335 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:16.335 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:16.335 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:16.336 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:16.336 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:16.336 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:28:16.336 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:16.698 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:17.618 7f9f8ee3c0f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:28:17.699 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:18.701 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:19.703 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:20.335 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:20.704 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:21.705 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:22.706 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:23.707 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:24.709 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:25.338 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:25.338 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:25.338 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:25.338 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:25.338 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:25.338 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:25.339 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:25.339 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:25.339 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:25.339 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:25.339 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:25.339 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:28:25.339 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:25.710 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:26.712 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:27.713 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:28.715 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:29.339 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:29.716 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:30.718 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:31.720 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:32.722 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:33.723 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:34.341 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:34.342 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:34.342 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:34.342 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:34.342 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:34.342 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:34.343 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:34.343 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:34.343 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:34.343 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:34.344 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:34.344 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:28:34.344 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:34.725 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:35.726 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:36.727 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:37.728 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:38.342 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:38.729 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:39.730 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:40.731 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:41.732 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:42.734 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:43.345 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:43.345 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:43.345 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:43.345 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:43.345 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:43.345 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:43.346 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:43.346 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:43.346 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:43.346 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:43.346 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:43.346 7f9f8ee3c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:28:43.346 7f9f8ee3c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:43.736 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:44.737 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:45.738 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:46.739 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:47.346 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:47.739 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:48.741 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:49.742 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:50.744 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:51.745 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:52.348 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:52.348 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:52.348 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:52.349 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:52.349 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:52.349 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:52.349 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:52.349 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:52.350 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:52.350 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:52.350 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:52.350 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:28:52.350 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:52.746 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:53.747 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:54.748 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:55.750 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:56.349 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:56.751 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:57.753 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:58.754 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:59.755 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:00.756 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:01.351 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:01.351 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:01.351 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:01.352 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:01.352 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:01.352 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:01.352 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:01.352 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:01.352 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:01.353 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:01.353 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:01.353 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:29:01.353 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:01.757 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:02.758 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:03.759 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:04.760 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:05.352 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:05.761 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:06.762 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:07.764 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:08.765 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:09.766 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:10.355 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:10.355 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:10.356 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:10.356 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:10.356 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:10.356 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:10.356 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:10.356 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:10.357 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:10.357 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:10.357 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:10.357 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:29:10.357 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:10.767 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:11.769 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:12.770 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:13.771 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:14.357 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:14.773 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:15.774 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:16.776 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:17.777 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:18.779 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:19.360 7f9f8ef48f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:19.360 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:19.361 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:19.361 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:19.362 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:19.362 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:19.363 7f9f8ef48f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:19.363 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:19.363 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:19.363 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:19.363 7f9f8ef48f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:19.363 7f9f8ef48f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:29:19.364 7f9f8ef48f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:19.781 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:20.783 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:21.784 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:22.786 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:23.361 7f9f887a7d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:23.788 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:24.789 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:25.790 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:26.792 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:27.793 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:28.363 7f9f887a7d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:28.363 7f9f887a7d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:28.363 7f9f887a7d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:28.364 7f9f887a7d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:28.364 7f9f887a7d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:28.364 7f9f887a7d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:28.364 7f9f887a7d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:28.364 7f9f887a7d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:28.365 7f9f887a7d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:28.365 7f9f887a7d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:28.365 7f9f887a7d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:28.365 7f9f887a7d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:29:28.365 7f9f887a7d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:28.794 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:29.795 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:30.798 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:31.800 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:32.364 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:32.801 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:33.802 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:34.804 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:35.806 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:36.807 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:37.366 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:37.367 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:37.367 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:37.367 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:37.367 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:37.367 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:37.368 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:37.368 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:37.368 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:37.368 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:37.368 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:37.369 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:29:37.369 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:37.809 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:38.810 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:39.811 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:40.812 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:41.368 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:41.813 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:42.814 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:43.815 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:44.817 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:45.818 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:46.369 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:46.369 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:46.370 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:46.370 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:46.370 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:46.370 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:46.370 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:46.371 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:46.371 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:46.371 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:46.371 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:46.371 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:29:46.371 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:46.819 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:47.821 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:48.822 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:49.823 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:50.370 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:50.824 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:51.826 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:52.828 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:53.829 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:54.830 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:55.372 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:55.373 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:55.373 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:55.373 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:55.373 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:55.373 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:55.374 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:55.374 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:55.374 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:55.374 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:55.374 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:55.374 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:29:55.374 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:55.831 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:56.832 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:57.834 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:58.836 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:59.372 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:59.837 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:00.838 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:01.839 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:02.841 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:03.842 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:04.374 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:04.375 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:04.375 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:04.375 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:04.375 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:04.375 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:04.376 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:04.376 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:04.376 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:04.377 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:04.377 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:04.377 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:30:04.377 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:04.844 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:05.846 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:06.847 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:07.848 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:08.376 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:08.849 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:09.850 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:10.851 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:11.853 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:12.855 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:13.378 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:13.379 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:13.379 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:13.379 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:13.379 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:13.379 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:13.380 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:13.380 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:13.380 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:13.380 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:13.380 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:13.381 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:30:13.381 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:13.856 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:14.857 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:15.859 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:16.861 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:17.380 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:17.863 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:18.863 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:19.865 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:20.867 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:21.868 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:22.383 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:22.383 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:22.383 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:22.383 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:22.383 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:22.384 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:22.384 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:22.384 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:22.384 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:22.384 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:22.384 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:22.385 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:30:22.385 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:22.869 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:23.871 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:24.872 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:25.873 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:26.384 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:26.875 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:27.876 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:28.878 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:29.880 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:30.881 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:31.386 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:31.386 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:31.386 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:31.387 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:31.387 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:31.387 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:31.387 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:31.387 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:31.387 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:31.388 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:31.388 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:31.388 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:30:31.388 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:31.882 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:32.883 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:33.885 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:34.887 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:35.387 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:35.888 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:36.889 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:37.892 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:38.893 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:39.894 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:40.389 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:40.390 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:40.390 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:40.390 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:40.390 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:40.390 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:40.391 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:40.391 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:40.392 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:40.392 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:40.392 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:40.392 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:30:40.392 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:40.896 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:41.897 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:42.898 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:43.900 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:44.390 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:44.902 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:45.903 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:46.905 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:47.906 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:48.907 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:49.392 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:49.393 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:49.393 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:49.393 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:49.393 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:49.393 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:49.394 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:49.394 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:49.394 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:49.394 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:49.394 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:49.394 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:30:49.394 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:49.909 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:50.910 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:51.911 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:52.913 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:53.393 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:53.915 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:54.916 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:55.918 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:56.920 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:57.921 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:58.396 7f9f8926ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:58.397 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:58.397 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:58.397 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:58.397 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:58.397 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:58.398 7f9f8926ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:58.398 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:58.398 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:58.398 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:58.398 7f9f8926ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:58.399 7f9f8926ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:30:58.399 7f9f8926ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:58.923 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:59.924 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:00.925 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:01.926 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:02.397 7f9f887492e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:02.928 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:03.929 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:04.930 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:05.931 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:06.933 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:07.399 7f9f887492e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:07.399 7f9f887492e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:07.400 7f9f887492e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:07.400 7f9f887492e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:07.400 7f9f887492e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:07.400 7f9f887492e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:07.400 7f9f887492e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:07.401 7f9f887492e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:07.401 7f9f887492e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:07.401 7f9f887492e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:07.401 7f9f887492e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:07.401 7f9f887492e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:31:07.401 7f9f887492e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:07.934 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:08.936 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:09.937 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:10.938 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:11.400 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:11.939 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:12.941 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:13.942 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:14.944 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:15.945 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:16.403 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:16.403 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:16.403 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:16.404 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:16.404 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:16.404 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:16.404 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:16.404 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:16.404 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:16.405 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:16.405 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:16.405 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:31:16.405 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:16.946 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:17.947 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:18.949 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:19.950 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:20.404 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:20.952 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:21.953 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:22.955 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:23.957 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:24.958 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:25.406 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:25.406 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:25.407 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:25.407 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:25.407 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:25.407 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:25.408 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:25.408 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:25.408 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:25.408 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:25.409 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:25.409 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:31:25.409 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:25.959 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:26.961 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:27.962 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:28.964 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:29.407 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:29.965 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:30.967 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:31.968 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:32.969 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:33.971 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:34.409 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:34.409 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:34.409 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:34.409 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:34.409 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:34.409 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:34.410 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:34.410 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:34.410 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:34.410 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:34.410 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:34.410 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:31:34.411 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:34.973 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:35.974 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:36.976 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:37.978 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:38.409 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:38.980 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:39.981 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:40.983 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:41.985 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:42.986 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:43.412 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:43.412 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:43.413 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:43.413 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:43.413 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:43.413 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:43.413 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:43.414 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:43.414 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:43.414 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:43.414 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:43.414 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:31:43.414 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:43.987 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:44.577 7f9f8887f2e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:31:44.989 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:45.991 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:46.993 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:47.413 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:47.995 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:48.995 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:49.997 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:50.999 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:52.000 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:52.415 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:52.416 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:52.416 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:52.416 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:52.416 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:52.416 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:52.417 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:52.417 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:52.417 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:52.417 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:52.417 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:52.417 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:31:52.417 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:53.002 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:54.003 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:55.005 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:56.007 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:56.416 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:57.009 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:58.010 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:59.012 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:00.014 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:01.016 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:01.418 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:01.418 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:01.418 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:01.418 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:01.418 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:01.418 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:01.419 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:01.419 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:01.419 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:01.419 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:01.419 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:01.419 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:32:01.420 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:02.018 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:03.019 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:04.021 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:05.023 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:05.418 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:06.025 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:07.025 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:08.027 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:09.028 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:10.030 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:10.420 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:10.421 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:10.421 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:10.421 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:10.421 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:10.421 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:10.422 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:10.422 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:10.422 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:10.422 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:10.422 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:10.422 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:32:10.422 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:11.031 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:12.033 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:13.033 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:14.035 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:14.421 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:15.037 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:16.038 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:17.040 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:18.042 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:19.043 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:19.423 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:19.423 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:19.423 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:19.424 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:19.424 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:19.424 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:19.424 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:19.424 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:19.424 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:19.425 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:19.425 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:19.425 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:32:19.425 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:20.045 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:21.046 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:22.048 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:23.050 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:23.424 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:24.052 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:25.054 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:26.056 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:26.207 7f9f8936b8d0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:32:27.058 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:28.060 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:28.426 7f9f8887f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:28.426 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:28.426 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:28.426 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:28.427 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:28.427 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:28.427 7f9f8887f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:28.427 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:28.427 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:28.427 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:28.428 7f9f8887f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:28.428 7f9f8887f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:32:28.428 7f9f8887f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:29.061 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:30.063 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:31.065 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:32.067 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:32.427 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:33.069 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:34.071 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:35.073 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:36.075 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:37.076 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:37.429 7f9f887478d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:37.429 7f9f887478d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:37.429 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:37.429 7f9f887478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:37.429 7f9f887478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:37.429 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:37.430 7f9f887478d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:37.430 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:37.430 7f9f887478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:37.430 7f9f887478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:37.430 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:37.430 7f9f887478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:32:37.430 7f9f887478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:38.094 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:39.095 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:40.097 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:40.181 7f9f887478d0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:32:41.098 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:41.430 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:42.099 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:43.101 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:44.103 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:45.105 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:46.106 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:46.432 7f9f887478d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:46.432 7f9f887478d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:46.432 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:46.433 7f9f887478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:46.433 7f9f887478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:46.433 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:46.434 7f9f887478d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:46.434 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:46.434 7f9f887478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:46.434 7f9f887478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:46.434 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:46.434 7f9f887478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:32:46.434 7f9f887478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:47.107 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:48.109 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:49.110 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:50.112 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:50.433 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:51.114 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:52.125 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:53.127 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:54.128 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:55.130 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:55.435 7f9f887478d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:55.436 7f9f887478d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:55.436 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:55.436 7f9f887478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:55.436 7f9f887478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:55.436 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:55.437 7f9f887478d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:55.437 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:55.437 7f9f887478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:55.437 7f9f887478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:55.437 7f9f887478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:55.437 7f9f887478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:32:55.437 7f9f887478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:56.132 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:57.133 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:57.181 7f9f9330df60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:32:58.134 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:59.136 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:59.437 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:00.136 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:01.138 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:02.139 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:03.141 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:04.142 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:04.439 7f9f9330df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:04.439 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:04.439 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:04.440 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:04.440 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:04.440 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:04.440 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:04.441 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:04.441 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:04.441 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:04.441 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:04.441 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:33:04.441 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:05.145 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:06.145 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:07.147 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:08.149 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:08.440 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:09.150 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:10.152 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:11.153 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:12.155 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:13.156 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:13.442 7f9f9330df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:13.442 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:13.442 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:13.443 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:13.443 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:13.443 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:13.444 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:13.444 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:13.444 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:13.444 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:13.444 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:13.444 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:33:13.444 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:14.158 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:15.159 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:16.161 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:17.162 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:17.442 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:18.164 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:19.165 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:20.167 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:21.168 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:22.170 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:22.445 7f9f9330df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:22.445 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:22.445 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:22.445 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:22.445 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:22.445 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:22.446 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:22.446 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:22.446 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:22.446 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:22.446 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:22.446 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:33:22.446 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:23.172 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:24.173 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:25.175 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:26.175 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:26.447 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:27.178 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:28.179 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:29.181 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:30.184 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:31.187 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:31.450 7f9f9330df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:31.451 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:31.451 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:31.451 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:31.451 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:31.451 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:31.452 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:31.452 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:31.452 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:31.452 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:31.452 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:31.452 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:33:31.452 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:32.189 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:33.191 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:34.192 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:35.194 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:35.451 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:36.196 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:37.197 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:38.199 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:39.200 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:40.201 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:40.453 7f9f9330df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:40.453 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:40.453 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:40.454 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:40.454 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:40.454 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:40.454 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:40.455 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:40.455 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:40.455 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:40.455 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:40.455 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:33:40.455 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:41.203 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:42.205 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:43.207 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:44.209 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:44.454 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:45.210 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:46.211 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:47.214 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:48.215 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:49.216 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:49.456 7f9f9330df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:49.456 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:49.456 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:49.457 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:49.457 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:49.457 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:49.457 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:49.457 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:49.458 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:49.458 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:49.458 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:49.458 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:33:49.458 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:50.218 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:51.219 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:52.221 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:53.222 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:53.457 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:54.224 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:55.226 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:56.227 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:57.228 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:58.229 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:58.459 7f9f9330df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:58.459 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:58.459 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:58.460 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:58.460 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:58.460 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:58.460 7f9f9330df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:58.460 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:58.460 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:58.461 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:58.461 7f9f9330df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:58.461 7f9f9330df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:33:58.461 7f9f9330df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:59.231 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:00.233 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:01.235 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:02.236 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:02.459 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:03.239 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:04.240 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:05.242 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:06.244 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:07.245 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:07.461 7f9f887a00f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:07.462 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:07.462 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:07.462 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:07.462 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:07.462 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:07.463 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:07.463 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:07.463 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:07.463 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:07.463 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:07.463 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:34:07.464 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:08.247 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:09.248 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:10.249 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:11.251 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:11.462 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:12.253 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:13.254 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:14.256 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:15.257 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:16.260 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:16.465 7f9f887a00f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:16.465 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:16.465 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:16.465 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:16.465 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:16.465 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:16.466 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:16.466 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:16.466 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:16.466 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:16.466 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:16.467 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:34:16.467 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:17.261 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:18.262 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:19.263 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:20.265 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:20.465 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:21.267 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:22.268 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:23.270 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:24.272 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:25.273 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:25.468 7f9f887a00f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:25.468 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:25.468 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:25.468 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:25.468 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:25.469 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:25.469 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:25.469 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:25.469 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:25.470 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:25.470 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:25.470 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:34:25.470 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:26.275 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:27.276 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:28.277 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:29.279 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:29.468 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:30.281 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:31.283 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:32.284 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:33.285 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:34.287 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:34.471 7f9f887a00f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:34.471 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:34.471 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:34.471 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:34.471 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:34.471 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:34.472 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:34.472 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:34.472 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:34.472 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:34.472 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:34.472 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:34:34.472 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:35.288 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:36.289 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:37.291 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:38.293 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:38.472 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:39.295 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:40.297 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:41.299 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:42.300 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:43.302 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:43.474 7f9f887a00f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:43.474 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:43.474 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:43.474 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:43.474 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:43.475 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:43.476 7f9f887a00f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:43.476 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:43.476 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:43.476 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:43.476 7f9f887a00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:43.476 7f9f887a00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:34:43.476 7f9f887a00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:44.304 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:45.305 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:46.307 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:47.309 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:47.475 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:48.311 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:49.313 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:50.315 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:51.316 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:52.317 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:52.477 7f9f8a1a7438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:52.477 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:52.477 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:52.477 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:52.479 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:52.479 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:52.479 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:52.480 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:52.480 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:52.480 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:52.480 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:52.480 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:34:52.480 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:53.319 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:54.320 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:55.322 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:56.324 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:56.477 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:57.326 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:58.327 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:59.329 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:00.331 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:01.332 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:01.480 7f9f8a1a7438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:01.480 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:01.481 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:01.481 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:01.481 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:01.481 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:01.482 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:01.482 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:01.482 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:01.482 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:01.482 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:01.482 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:35:01.482 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:02.334 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:03.335 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:04.337 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:05.339 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:05.480 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:06.341 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:07.343 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:08.345 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:09.346 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:10.348 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:10.483 7f9f8a1a7438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:10.483 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:10.483 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:10.483 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:10.484 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:10.484 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:10.484 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:10.484 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:10.485 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:10.485 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:10.485 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:10.485 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:35:10.485 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:11.349 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:12.350 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:13.352 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:14.354 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:14.483 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:15.356 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:16.357 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:17.359 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:18.360 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:19.362 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:19.485 7f9f8a1a7438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:19.485 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:19.485 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:19.485 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:19.485 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:19.486 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:19.486 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:19.486 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:19.486 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:19.486 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:19.486 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:19.487 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:35:19.487 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:20.364 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:21.365 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:22.366 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:23.368 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:23.485 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:24.370 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:25.371 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:26.373 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:27.375 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:28.377 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:28.487 7f9f8a1a7438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:28.488 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:28.488 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:28.488 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:28.488 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:28.488 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:28.489 7f9f8a1a7438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:28.489 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:28.489 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:28.489 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:28.489 7f9f8a1a7438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:28.489 7f9f8a1a7438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:35:28.489 7f9f8a1a7438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:29.379 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:30.381 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:31.383 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:32.385 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:32.489 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:33.387 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:34.388 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:35.390 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:36.391 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:37.393 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:37.490 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:37.491 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:37.491 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:37.491 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:37.491 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:37.491 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:37.492 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:37.492 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:37.492 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:37.492 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:37.492 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:37.492 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:35:37.492 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:38.395 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:39.397 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:40.398 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:41.401 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:41.490 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:42.402 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:43.404 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:44.405 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:45.406 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:46.408 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:46.492 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:46.493 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:46.493 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:46.493 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:46.493 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:46.493 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:46.494 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:46.494 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:46.494 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:46.494 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:46.494 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:46.494 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:35:46.494 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:47.410 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:48.411 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:49.413 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:50.414 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:50.493 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:51.416 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:52.417 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:53.419 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:54.420 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:55.422 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:55.494 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:55.495 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:55.495 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:55.495 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:55.495 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:55.495 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:55.496 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:55.496 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:55.496 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:55.496 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:55.496 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:55.496 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:35:55.496 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:56.424 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:57.425 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:58.426 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:58.453 7f9f8a1a7ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:35:59.428 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:59.495 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:00.429 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:01.431 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:02.433 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:03.434 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:04.436 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:04.498 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:04.498 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:04.498 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:04.498 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:04.498 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:04.499 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:04.499 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:04.499 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:04.499 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:04.499 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:04.499 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:04.500 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:36:04.500 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:05.438 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:06.440 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:07.441 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:08.442 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:08.498 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:09.444 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:10.446 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:11.447 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:12.449 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:13.450 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:13.500 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:13.500 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:13.500 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:13.501 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:13.501 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:13.501 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:13.501 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:13.501 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:13.502 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:13.502 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:13.502 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:13.502 7f9f8a1a7ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:36:13.502 7f9f8a1a7ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:14.453 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:15.454 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:16.455 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:17.457 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:17.501 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:18.459 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:19.460 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:20.461 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:21.464 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:22.465 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:22.503 7f9f8936b8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:22.503 7f9f8936b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:22.503 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:22.503 7f9f8936b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:22.504 7f9f8936b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:22.504 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:22.504 7f9f8936b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:22.505 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:22.505 7f9f8936b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:22.505 7f9f8936b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:22.505 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:22.505 7f9f8936b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:36:22.505 7f9f8936b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:23.467 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:24.469 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:25.471 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:26.473 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:26.503 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:27.475 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:28.476 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:29.478 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:30.480 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:31.481 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:31.505 7f9f8936b8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:31.505 7f9f8936b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:31.505 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:31.506 7f9f8936b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:31.506 7f9f8936b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:31.506 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:31.506 7f9f8936b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:31.506 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:31.506 7f9f8936b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:31.507 7f9f8936b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:31.507 7f9f8936b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:31.507 7f9f8936b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:36:31.507 7f9f8936b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:32.484 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:33.485 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:34.487 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:35.488 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:35.505 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:36.490 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:37.491 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:38.493 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:39.495 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:40.496 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:40.507 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:40.507 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:40.507 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:40.507 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:40.507 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:40.507 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:40.508 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:40.508 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:40.508 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:40.508 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:40.508 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:40.508 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:36:40.508 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:41.498 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:42.500 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:43.502 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:44.504 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:44.507 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:45.505 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:46.506 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:47.508 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:48.509 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:49.510 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:49.511 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:49.511 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:49.511 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:49.511 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:49.511 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:49.512 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:49.512 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:49.512 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:49.512 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:49.512 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:49.512 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:36:49.513 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:49.513 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:50.521 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:51.523 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:52.524 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:53.511 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:53.525 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:54.526 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:55.527 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:56.529 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:57.530 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:58.514 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:58.514 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:58.514 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:58.515 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:58.515 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:58.515 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:58.516 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:58.516 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:58.516 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:58.516 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:58.516 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:58.516 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:36:58.517 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:58.532 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:59.533 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:00.535 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:01.537 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:02.516 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:02.538 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:03.540 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:04.541 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:05.543 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:06.545 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:07.518 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:07.519 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:07.519 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:07.519 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:07.519 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:07.519 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:07.520 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:07.520 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:07.520 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:07.520 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:07.520 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:07.520 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:37:07.520 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:07.546 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:08.548 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:09.549 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:10.551 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:11.519 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:11.552 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:12.554 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:13.556 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:14.557 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:15.559 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:16.521 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:16.522 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:16.522 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:16.522 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:16.522 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:16.522 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:16.523 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:16.523 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:16.523 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:16.523 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:16.523 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:16.523 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:37:16.523 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:16.560 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:17.561 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:18.563 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:19.564 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:20.522 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:20.565 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:21.567 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:22.568 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:23.570 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:24.571 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:25.525 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:25.525 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:25.525 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:25.525 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:25.525 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:25.526 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:25.526 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:25.526 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:25.526 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:25.526 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:25.526 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:25.527 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:37:25.527 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:25.573 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:26.575 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:27.577 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:28.578 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:29.526 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:29.580 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:30.582 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:31.583 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:32.585 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:33.586 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:34.528 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:34.528 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:34.528 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:34.528 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:34.529 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:34.529 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:34.529 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:34.529 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:34.530 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:34.530 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:34.530 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:34.530 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:37:34.530 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:34.588 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:35.589 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:36.591 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:37.592 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:38.529 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:38.593 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:39.595 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:40.596 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:41.598 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:42.599 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:43.531 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:43.531 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:43.531 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:43.532 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:43.532 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:43.532 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:43.532 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:43.532 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:43.532 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:43.533 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:43.533 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:43.533 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:37:43.533 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:43.601 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:44.602 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:45.604 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:46.605 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:47.532 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:47.606 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:48.607 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:49.608 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:50.610 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:51.611 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:52.535 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:52.535 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:52.535 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:52.536 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:52.536 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:52.536 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:52.537 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:52.537 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:52.537 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:52.537 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:52.537 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:52.537 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:37:52.537 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:52.612 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:53.614 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:54.615 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:55.616 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:56.536 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:56.618 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:57.619 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:58.620 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:59.621 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:59.684 7f9f8955bcc0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:38:00.623 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:01.539 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:01.539 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:01.539 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:01.540 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:01.540 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:01.540 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:01.540 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:01.540 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:01.541 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:01.541 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:01.541 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:01.541 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:38:01.541 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:01.624 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:02.626 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:03.627 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:04.629 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:05.540 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:05.630 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:06.631 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:07.632 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:08.634 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:09.635 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:10.543 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:10.543 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:10.543 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:10.544 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:10.544 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:10.544 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:10.544 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:10.544 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:10.544 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:10.545 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:10.545 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:10.545 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:38:10.545 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:10.636 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:11.637 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:12.638 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:13.639 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:13.697 7f9f89337ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:38:14.543 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:14.641 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:15.642 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:16.643 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:17.644 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:18.647 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:19.546 7f9f89337ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:19.546 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:19.546 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:19.546 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:19.546 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:19.546 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:19.547 7f9f89337ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:19.547 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:19.547 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:19.547 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:19.547 7f9f89337ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:19.548 7f9f89337ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:38:19.548 7f9f89337ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:19.648 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:20.649 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:21.650 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:22.651 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:23.548 7f9f8928ce10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:23.652 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:24.654 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:25.654 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:26.655 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:27.656 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:28.550 7f9f8928ce10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:28.550 7f9f8928ce10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:28.550 7f9f8928ce10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:28.551 7f9f8928ce10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:28.551 7f9f8928ce10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:28.551 7f9f8928ce10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:28.551 7f9f8928ce10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:28.552 7f9f8928ce10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:28.552 7f9f8928ce10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:28.552 7f9f8928ce10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:28.552 7f9f8928ce10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:28.552 7f9f8928ce10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:38:28.552 7f9f8928ce10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:28.657 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:29.659 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:30.661 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:31.059 7f9f88747a20 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:38:31.663 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:32.551 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:32.664 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:33.665 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:34.667 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:35.669 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:36.670 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:37.554 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:37.554 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:37.554 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:37.554 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:37.554 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:37.554 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:37.555 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:37.555 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:37.555 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:37.555 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:37.555 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:37.556 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:38:37.556 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:37.671 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:38.671 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:39.672 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:40.674 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:41.554 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:41.675 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:42.677 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:43.678 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:44.679 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:45.681 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:46.557 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:46.557 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:46.557 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:46.557 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:46.558 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:46.558 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:46.558 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:46.558 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:46.558 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:46.558 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:46.559 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:46.559 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:38:46.559 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:46.683 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:47.684 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:48.685 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:49.686 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:50.558 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:50.688 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:51.689 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:52.690 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:53.691 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:54.692 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:55.561 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:55.561 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:55.561 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:55.562 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:55.562 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:55.562 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:55.562 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:55.563 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:55.563 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:55.563 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:55.563 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:55.563 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:38:55.563 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:55.693 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:56.695 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:57.697 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:58.699 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:59.562 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:59.700 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:00.702 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:01.703 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:02.704 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:03.705 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:04.565 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:04.565 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:04.565 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:04.566 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:04.566 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:04.566 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:04.567 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:04.567 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:04.567 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:04.567 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:04.567 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:04.567 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:39:04.568 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:04.707 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:05.708 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:06.709 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:07.710 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:08.566 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:08.713 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:09.715 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:10.717 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:11.718 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:12.720 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:13.573 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:13.573 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:13.573 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:13.573 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:13.573 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:13.573 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:13.574 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:13.574 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:13.574 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:13.574 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:13.574 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:13.574 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:39:13.574 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:13.725 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:14.730 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:15.732 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:16.733 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:17.574 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:17.734 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:18.735 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:19.737 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:20.738 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:21.739 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:22.576 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:22.576 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:22.576 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:22.577 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:22.577 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:22.577 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:22.577 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:22.577 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:22.578 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:22.578 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:22.578 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:22.578 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:39:22.578 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:22.740 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:23.741 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:24.743 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:25.744 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:26.577 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:26.746 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:27.747 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:28.748 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:29.750 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:30.751 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:31.581 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:31.581 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:31.581 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:31.581 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:31.582 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:31.582 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:31.582 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:31.582 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:31.582 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:31.582 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:31.583 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:31.583 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:39:31.583 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:31.753 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:32.754 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:33.756 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:34.757 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:35.582 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:35.758 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:36.760 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:37.762 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:38.763 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:39.763 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:40.585 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:40.585 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:40.585 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:40.585 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:40.586 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:40.586 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:40.586 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:40.586 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:40.586 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:40.587 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:40.587 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:40.587 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:39:40.587 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:40.765 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:41.766 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:42.768 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:43.769 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:44.586 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:44.770 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:45.771 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:46.773 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:47.775 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:48.777 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:49.589 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:49.590 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:49.590 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:49.590 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:49.590 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:49.590 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:49.591 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:49.592 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.592 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:49.592 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.592 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.592 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:39:49.592 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.778 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:50.780 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:51.782 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:52.784 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:53.590 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:53.785 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:54.786 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:55.787 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:56.789 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:57.790 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:58.593 7f9f8941b0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:58.593 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:58.593 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:58.594 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:58.594 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:58.594 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:58.595 7f9f8941b0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:58.595 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.595 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:58.595 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.595 7f9f8941b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.596 7f9f8941b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:39:58.596 7f9f8941b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.792 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:59.794 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:00.795 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:01.796 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:02.594 7f9f888b7198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:02.798 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:03.800 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:04.801 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:05.802 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:06.803 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:07.597 7f9f888b7198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:07.597 7f9f888b7198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:07.597 7f9f888b7198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:07.597 7f9f888b7198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:07.598 7f9f888b7198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:07.598 7f9f888b7198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:07.598 7f9f888b7198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:07.598 7f9f888b7198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.598 7f9f888b7198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:07.599 7f9f888b7198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.599 7f9f888b7198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.599 7f9f888b7198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:40:07.599 7f9f888b7198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.804 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:08.805 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:09.807 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:10.808 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:11.597 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:11.809 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:12.810 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:13.811 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:14.812 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:15.813 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:16.600 7f9f890992e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:16.600 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:16.600 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:16.601 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:16.601 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:16.601 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:16.602 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:16.602 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.602 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:16.602 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.603 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.603 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:40:16.603 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.815 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:17.817 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:18.818 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:19.820 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:20.601 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:20.821 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:21.822 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:22.823 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:23.824 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:24.825 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:25.247 7f9f88846eb8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:40:25.602 7f9f890992e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:25.603 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:25.603 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:25.603 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:25.603 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:25.603 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:25.604 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:25.605 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.605 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:25.605 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.605 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.605 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:40:25.605 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.826 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:26.828 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:27.830 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:28.831 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:29.603 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:29.833 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:30.834 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:31.835 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:32.837 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:33.838 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:34.606 7f9f890992e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:34.606 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:34.606 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:34.606 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:34.607 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:34.607 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:34.607 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:34.607 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.607 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:34.607 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.607 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.608 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:40:34.608 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.839 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:35.840 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:36.841 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:37.843 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:38.607 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:38.844 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:39.846 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:40.847 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:41.849 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:42.850 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:43.610 7f9f890992e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:43.610 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:43.610 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:43.611 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:43.611 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:43.611 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:43.612 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:43.612 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.612 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:43.612 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.612 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.612 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:40:43.612 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.852 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:44.853 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:45.854 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:46.855 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:47.610 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:47.857 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:48.858 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:49.860 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:50.861 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:51.863 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:52.612 7f9f890992e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:52.613 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:52.613 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:52.613 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:52.613 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:52.613 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:52.614 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:52.614 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.614 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:52.614 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.614 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.614 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:40:52.614 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.864 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:53.866 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:54.868 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:55.869 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:56.613 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:56.871 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:57.873 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:58.874 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:59.876 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:00.877 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:01.616 7f9f890992e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:01.617 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:01.617 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:01.617 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:01.617 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:01.617 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:01.617 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:01.618 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.618 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:01.618 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.618 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.618 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:41:01.618 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.878 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:02.880 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:03.881 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:04.882 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:05.617 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:05.883 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:06.885 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:07.886 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:08.888 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:09.890 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:10.621 7f9f890992e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:10.621 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:10.621 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:10.621 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:10.622 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:10.622 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:10.622 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:10.622 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.623 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:10.623 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.623 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.623 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:41:10.623 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.891 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:11.893 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:12.894 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:13.896 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:14.622 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:14.897 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:15.899 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:16.900 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:17.901 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:18.903 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:19.625 7f9f890992e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:19.625 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:19.625 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:19.625 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:19.625 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:19.625 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:19.626 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:19.626 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.626 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:19.626 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.626 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.626 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:41:19.626 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.905 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:20.906 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:21.908 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:22.910 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:23.626 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:23.911 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:24.913 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:25.914 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:26.915 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:27.917 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:28.629 7f9f890992e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:28.630 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:28.630 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:28.630 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:28.630 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:28.630 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:28.630 7f9f890992e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:28.631 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.631 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:28.631 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.631 7f9f890992e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.631 7f9f890992e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:41:28.631 7f9f890992e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.918 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:29.919 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:30.921 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:31.922 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:32.630 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:32.923 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:33.924 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:34.925 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:35.926 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:36.928 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:37.633 7f9f887b1780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:37.633 7f9f887b1780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:37.633 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:37.633 7f9f887b1780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:37.633 7f9f887b1780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:37.634 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:37.634 7f9f887b1780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:37.634 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.634 7f9f887b1780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:37.634 7f9f887b1780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.634 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.635 7f9f887b1780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:41:37.635 7f9f887b1780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.929 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:38.930 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:39.931 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:40.932 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:41.634 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:41.933 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:42.935 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:43.936 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:44.938 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:45.939 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:46.637 7f9f887b1780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:46.637 7f9f887b1780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:46.637 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:46.637 7f9f887b1780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:46.637 7f9f887b1780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:46.638 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:46.638 7f9f887b1780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:46.638 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.639 7f9f887b1780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:46.639 7f9f887b1780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.639 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.639 7f9f887b1780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:41:46.639 7f9f887b1780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.941 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:47.942 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:48.943 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:49.944 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:50.638 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:50.946 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:51.948 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:52.949 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:53.951 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:54.952 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:55.640 7f9f887b1780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:55.640 7f9f887b1780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:55.641 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:55.641 7f9f887b1780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:55.641 7f9f887b1780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:55.641 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:55.642 7f9f887b1780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:55.642 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.642 7f9f887b1780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:55.642 7f9f887b1780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.642 7f9f887b1780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.642 7f9f887b1780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:41:55.642 7f9f887b1780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.954 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:56.956 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:57.957 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:58.958 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:59.641 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:59.959 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:00.961 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:01.963 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:02.964 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:03.965 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:04.643 7f9f88895630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:04.644 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:04.644 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:04.644 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:04.644 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:04.644 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:04.645 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:04.645 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.645 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:04.645 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.645 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.645 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:42:04.645 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.967 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:05.968 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:06.969 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:07.971 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:08.644 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:08.973 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:09.974 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:10.976 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:11.977 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:12.978 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:13.647 7f9f88895630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:13.647 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:13.647 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:13.647 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:13.647 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:13.648 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:13.648 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:13.648 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.648 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:13.648 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.648 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.649 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:42:13.649 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.980 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:14.981 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:15.983 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:16.985 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:17.648 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:17.986 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:18.987 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:19.989 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:20.990 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:21.991 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:22.650 7f9f88895630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:22.650 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:22.651 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:22.651 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:22.651 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:22.651 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:22.651 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:22.652 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.652 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:22.652 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.652 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.652 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:42:22.652 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.992 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:23.994 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:24.995 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:25.996 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:26.651 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:26.998 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:27.999 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:29.001 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:30.002 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:31.004 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:31.653 7f9f88895630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:31.654 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:31.654 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:31.654 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:31.654 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:31.654 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:31.655 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:31.655 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.656 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:31.656 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.656 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.656 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:42:31.657 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:32.006 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:33.008 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:34.009 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:35.011 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:35.654 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:36.012 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:37.013 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:38.015 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:39.016 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:40.018 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:40.656 7f9f88895630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:40.657 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:40.657 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:40.657 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:40.657 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:40.657 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:40.658 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:40.659 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.659 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:40.659 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.659 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.659 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:42:40.659 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:41.019 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:42.020 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:43.021 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:44.022 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:44.657 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:45.023 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:46.026 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:47.028 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:48.029 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:49.031 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:49.660 7f9f88895630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:49.660 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:49.660 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:49.661 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:49.661 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:49.661 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:49.661 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:49.661 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.661 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:49.661 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.662 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.662 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:42:49.662 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:50.032 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:51.034 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:52.035 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:53.036 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:53.661 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:54.037 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:55.039 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:56.041 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:57.042 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:58.043 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:58.665 7f9f88895630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:58.665 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:58.665 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:58.665 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:58.665 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:58.665 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:58.666 7f9f88895630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:58.666 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.666 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:58.666 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.666 7f9f88895630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.666 7f9f88895630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:42:58.666 7f9f88895630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:59.044 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:00.046 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:01.048 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:02.049 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:02.665 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:03.050 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:04.052 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:05.054 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:06.055 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:07.056 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:07.668 7f9f8916b8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:07.668 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:07.668 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:07.669 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:07.669 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:07.669 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:07.669 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:07.669 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.669 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:07.670 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.670 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.670 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:43:07.670 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:08.058 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:09.060 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:10.061 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:11.062 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:11.669 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:12.063 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:13.065 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:14.067 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:15.068 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:16.070 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:16.672 7f9f8916b8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:16.672 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:16.672 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:16.672 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:16.672 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:16.673 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:16.673 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:16.673 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.673 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:16.673 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.674 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.674 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:43:16.674 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:17.072 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:18.073 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:19.074 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:20.076 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:20.673 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:21.078 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:22.080 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:23.081 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:24.083 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:25.085 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:25.675 7f9f8916b8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:25.675 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:25.675 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:25.676 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:25.676 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:25.676 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:25.676 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:25.677 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.677 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:25.678 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.678 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.678 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:43:25.678 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:26.087 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:27.088 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:28.090 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:29.091 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:29.676 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:30.093 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:31.094 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:32.096 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:33.098 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:34.100 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:34.678 7f9f8916b8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:34.678 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:34.679 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:34.679 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:34.679 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:34.679 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:34.680 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:34.680 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.680 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:34.680 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.681 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.681 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:43:34.681 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:35.101 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:36.102 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:37.103 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:38.105 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:38.679 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:39.106 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:40.108 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:41.109 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:42.111 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:43.112 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:43.682 7f9f8916b8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:43.682 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:43.682 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:43.682 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:43.682 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:43.682 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:43.683 7f9f8916b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:43.683 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.683 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:43.683 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.683 7f9f8916b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.683 7f9f8916b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:43:43.684 7f9f8916b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:44.114 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:45.115 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:46.117 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:47.119 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:47.682 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:48.121 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:49.123 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:50.125 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:51.126 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:52.127 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:52.685 7f9f887a0630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:52.685 7f9f887a0630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:52.685 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:52.685 7f9f887a0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:52.685 7f9f887a0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:52.685 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:52.686 7f9f887a0630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:52.686 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.686 7f9f887a0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:52.686 7f9f887a0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.686 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.686 7f9f887a0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:43:52.687 7f9f887a0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:53.129 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:54.130 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:55.131 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:56.111 7f9f887a0630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:43:56.133 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:56.685 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:57.117 7f9f88801f60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:43:57.134 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:58.135 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:59.137 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:00.138 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:01.139 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:01.688 7f9f887a0630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:44:01.689 7f9f887a0630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:44:01.689 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:44:01.689 7f9f887a0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:44:01.689 7f9f887a0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:44:01.689 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:44:01.690 7f9f887a0630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:44:01.690 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.690 7f9f887a0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:44:01.690 7f9f887a0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.690 7f9f887a0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.690 7f9f887a0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 120 http_port = 8096 start_time = 1729476084694183 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 13 >> 10/21/2024 02:44:01.690 7f9f887a0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:02.141 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:03.142 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:04.143 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:05.144 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:05.689 7f9f8a12c438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:44:06.145 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:07.146 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:08.163 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:09.165 7f9f8955ba20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process.