09/01/2025 01:34:42.917 7fb2da906540 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/01/2025 01:34:42.917 7fb2da906540 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/01/2025 01:34:42.917 7fb2da906540 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/01/2025 01:34:42.917 7fb2d4e48040 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 09/01/2025 01:34:42.918 7fb2d4e48040 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:34:42.918 7fb2d4e48040 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/01/2025 01:34:42.918 7fb2d4e48040 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/01/2025 01:34:42.918 7fb2d4e48040 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:42.918 7fb2d4e48040 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:34:42.918 7fb2d4e48040 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:42.918 7fb2d4e48040 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:42.919 7fb2d4e48040 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 start_time = 1756690482918542 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/01/2025 01:34:42.919 7fb2d4e48040 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:42.940 7fb2da906540 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//'] 09/01/2025 01:34:42.947 7fb2da906540 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:34:42.948 7fb2d4e489a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:42.948 7fb2d4e489a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:42.948 7fb2d4e489a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:42.948 7fb2d4e489a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:42.948 7fb2d4e489a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:42.948 7fb2d4e489a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:42.998 7fb2da906540 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:34:42.999 7fb2d74bb4a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.000 7fb2d74bb4a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:34:43.000 7fb2d74bb4a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.012 7fb2da906540 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 09/01/2025 01:34:43.012 7fb2d4c020e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.013 7fb2d4c020e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:43.013 7fb2d4c020e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.016 7fb2da906540 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 09/01/2025 01:34:43.016 7fb2d4c020e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.016 7fb2d4c020e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:34:43.016 7fb2d4c020e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.024 7fb2da906540 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 09/01/2025 01:34:43.024 7fb2da906540 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 09/01/2025 01:34:43.026 7fb2da906540 [contrail-device-manager] [WARNING]: initializing cassandra cluster 09/01/2025 01:34:43.026 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 09/01/2025 01:34:43.027 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 09/01/2025 01:34:43.027 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 09/01/2025 01:34:43.027 7fb2d4c02680 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 09/01/2025 01:34:43.029 7fb2d4c02680 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 09/01/2025 01:34:43.029 7fb2d4c02900 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.029 7fb2d4c02900 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:34:43.029 7fb2d4c02900 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.031 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 09/01/2025 01:34:43.038 7fb2d4c02680 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 09/01/2025 01:34:43.039 7fb2d4c02540 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 09/01/2025 01:34:43.039 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 09/01/2025 01:34:43.084 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 09/01/2025 01:34:43.085 7fb2d4bf8540 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.086 7fb2d4bf8540 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 09/01/2025 01:34:43.086 7fb2d4bf8540 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.097 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 09/01/2025 01:34:43.097 7fb2d4bf84a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.097 7fb2d4bf84a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:34:43.097 7fb2d4bf84a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:43.113 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 09/01/2025 01:34:43.198 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 09/01/2025 01:34:43.748 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:43.750 7fb2da906540 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 09/01/2025 01:34:43.754 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:44.111 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:44.191 7fb2da906540 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:34:44.199 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:44.937 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:44.941 7fb2da906540 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 09/01/2025 01:34:44.947 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:45.456 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:45.521 7fb2da906540 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:34:45.525 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:45.525 7fb2d4e489a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:45.525 7fb2d4e489a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:34:45.526 7fb2d4e489a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:45.529 7fb2d4c027c0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:45.530 7fb2d4c027c0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 09/01/2025 01:34:45.530 7fb2d4c027c0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:45.535 7fb2d4c027c0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:45.535 7fb2d4c027c0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:34:45.535 7fb2d4c027c0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:45.535 7fb2da906540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 09/01/2025 01:34:45.536 7fb2da906540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 09/01/2025 01:34:45.536 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 09/01/2025 01:34:45.536 7fb2da906540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-juju-k8s-1454-1 09/01/2025 01:34:45.538 7fb2d4c02540 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 09/01/2025 01:34:45.550 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-juju-k8s-1454-1'] 09/01/2025 01:34:45.554 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 09/01/2025 01:34:45.557 7fb2d4c02540 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 09/01/2025 01:34:45.562 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-juju-k8s-1454-1'] 09/01/2025 01:34:46.045 7fb2da906540 [contrail-device-manager] [DEBUG]: Fetching all containers 09/01/2025 01:34:46.153 7fb2da906540 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_api-dnsmasq-1 09/01/2025 01:34:46.564 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:46.704 7fb2da906540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-juju-k8s-1454-1.config_queue 09/01/2025 01:34:46.704 7fb2da906540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-juju-k8s-1454-1.tftp_queue 09/01/2025 01:34:46.918 7fb2d4c02b80 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:34:46.920 7fb2d4c02b80 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:34:46.920 7fb2d4c02b80 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:34:46.920 7fb2d4c02b80 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:34:46.922 7fb2d4c02b80 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:34:46.922 7fb2d4c02b80 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:34:46.922 7fb2d4c02b80 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:34:46.922 7fb2d4c02b80 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:34:46.922 7fb2d4c02b80 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:46.923 7fb2d4c02b80 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:46.924 7fb2d4c02b80 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:46.924 7fb2d4c02b80 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:46.924 7fb2d4c02b80 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:34:46.924 7fb2d4c02b80 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:47.206 7fb2da906540 [contrail-device-manager] [WARNING]: Process 111 prepared to run in Full mode... 09/01/2025 01:34:47.206 7fb2da906540 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 09/01/2025 01:34:47.206 7fb2da906540 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 09/01/2025 01:34:47.210 7fb2da906540 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/local/lib/python3.9/site-packages/cfgm_common/uve/config_updater] to home page 09/01/2025 01:34:47.210 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 09/01/2025 01:34:47.211 7fb2da906540 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/local/lib/python3.9/site-packages/cfgm_common/uve/greenlets] to home page 09/01/2025 01:34:47.211 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 09/01/2025 01:34:47.212 7fb2da906540 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/local/lib/python3.9/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 09/01/2025 01:34:47.212 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 09/01/2025 01:34:47.217 7fb2da906540 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/local/lib/python3.9/site-packages/device_manager/sandesh/dm_introspect] to home page 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 09/01/2025 01:34:47.218 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 09/01/2025 01:34:47.221 7fb2da906540 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/local/lib/python3.9/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 09/01/2025 01:34:47.221 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 09/01/2025 01:34:47.221 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 09/01/2025 01:34:47.221 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 09/01/2025 01:34:47.222 7fb2da906540 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/local/lib/python3.9/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 09/01/2025 01:34:47.222 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 09/01/2025 01:34:47.222 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 09/01/2025 01:34:47.222 7fb2da906540 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/local/lib/python3.9/site-packages/pysandesh/gen_py/sandesh_trace] to home page 09/01/2025 01:34:47.222 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 09/01/2025 01:34:47.222 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 09/01/2025 01:34:47.222 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 09/01/2025 01:34:47.222 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 09/01/2025 01:34:47.222 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 09/01/2025 01:34:47.223 7fb2da906540 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/local/lib/python3.9/site-packages/pysandesh/gen_py/sandesh_uve] to home page 09/01/2025 01:34:47.223 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 09/01/2025 01:34:47.223 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 09/01/2025 01:34:47.224 7fb2da906540 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 09/01/2025 01:34:47.226 7fb2da906540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 09/01/2025 01:34:47.488 7fb2d4d49d60 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 09/01/2025 01:34:47.488 7fb2d4d49d60 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 09/01/2025 01:34:47.488 7fb2cfdca040 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:47.488 7fb2cfdca040 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 09/01/2025 01:34:47.488 7fb2cfdca040 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:47.490 7fb2cfdca040 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:47.490 7fb2cfdca040 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 09/01/2025 01:34:47.490 7fb2cfdca040 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:47.564 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:47.579 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 09/01/2025 01:34:47.583 7fb2d4c02540 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 09/01/2025 01:34:47.607 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-juju-k8s-1454-1', 'device_manager_ztp.cn-jenkins-deploy-platform-juju-k8s-1454-1.config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-juju-k8s-1454-1.tftp_queue', 'device_manager_ztp.ztp_queue'] 09/01/2025 01:34:48.559 7fb2cfdca220 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:34:48.615 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:49.615 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:50.500 7fb2da906540 [contrail-device-manager] [ERROR]: predef payloads file does not exist: /opt/contrail/fabric_ansible_playbooks/conf/predef_payloads.json 09/01/2025 01:34:50.500 7fb2da906540 [contrail-device-manager] [ERROR]: Unable to load init data 09/01/2025 01:34:50.500 7fb2da906540 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 09/01/2025 01:34:50.500 7fb2da906540 [contrail-device-manager] [WARNING]: initializing cassandra cluster 09/01/2025 01:34:50.500 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 09/01/2025 01:34:50.501 7fb2cfdca220 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.501 7fb2cfdca220 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:50.501 7fb2cfdca220 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.501 7fb2cfdca220 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.501 7fb2cfdca220 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:34:50.501 7fb2cfdca220 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.503 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 09/01/2025 01:34:50.577 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 09/01/2025 01:34:50.584 7fb2cfdcacc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.584 7fb2cfdcacc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 09/01/2025 01:34:50.585 7fb2cfdcacc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.613 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 09/01/2025 01:34:50.646 7fb2cfdcacc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.646 7fb2cfdcacc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:34:50.646 7fb2cfdcacc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.647 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:50.704 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:50.837 7fb2da906540 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 09/01/2025 01:34:50.845 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:50.854 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:50.921 7fb2d42564a0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:34:50.922 7fb2d42564a0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:34:50.922 7fb2d42564a0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:34:50.922 7fb2d42564a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:34:50.922 7fb2d42564a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:34:50.922 7fb2d42564a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:34:50.922 7fb2d42564a0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:34:50.923 7fb2d42564a0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:34:50.923 7fb2d42564a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.923 7fb2d42564a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:34:50.923 7fb2d42564a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.923 7fb2d42564a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:50.923 7fb2d42564a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:34:50.923 7fb2d42564a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:51.059 7fb2da906540 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 09/01/2025 01:34:51.062 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:51.062 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 09/01/2025 01:34:51.103 7fb2da906540 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 09/01/2025 01:34:51.117 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:51.364 7fb2da906540 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 09/01/2025 01:34:51.370 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:51.379 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:51.474 7fb2da906540 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:34:51.478 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:51.483 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:51.648 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:51.685 7fb2da906540 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 09/01/2025 01:34:51.694 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:51.715 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:51.800 7fb2da906540 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:34:51.808 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:51.816 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:52.038 7fb2cfefed60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:34:52.169 7fb2da906540 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 09/01/2025 01:34:52.173 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:52.180 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:52.506 7fb2da906540 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:34:52.509 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:52.522 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:52.649 7fb2da906540 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 09/01/2025 01:34:52.649 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:52.652 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:52.657 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:34:52.721 7fb2da906540 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:34:52.724 7fb2da906540 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/01/2025 01:34:52.724 7fb2cfefee00 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.725 7fb2cfefee00 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:52.725 7fb2cfefee00 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.740 7fb2da906540 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//'] 09/01/2025 01:34:52.740 7fb2da906540 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:34:52.741 7fb2cfefecc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.741 7fb2cfefecc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:52.741 7fb2cfefecc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.742 7fb2cfefecc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.742 7fb2cfefecc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:52.742 7fb2cfefecc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.744 7fb2da906540 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:34:52.745 7fb2cfdca4a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.745 7fb2cfdca4a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:52.745 7fb2cfdca4a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.749 7fb2da906540 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 09/01/2025 01:34:52.750 7fb2cfdca4a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.750 7fb2cfdca4a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:52.750 7fb2cfdca4a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.752 7fb2da906540 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 09/01/2025 01:34:52.752 7fb2cfdca4a0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.752 7fb2cfdca4a0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:52.753 7fb2cfdca4a0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.753 7fb2cfdca4a0 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 09/01/2025 01:34:52.753 7fb2d4601180 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.754 7fb2d4601180 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:52.754 7fb2d4601180 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.756 7fb2cfdca4a0 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 09/01/2025 01:34:52.757 7fb2d4601540 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:52.757 7fb2d4601540 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:52.757 7fb2d4601540 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:53.650 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:54.652 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:54.922 7fb2cfefecc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:34:54.943 7fb2cfefecc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:34:54.943 7fb2cfefecc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:34:54.943 7fb2cfefecc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:34:54.943 7fb2cfefecc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:34:54.943 7fb2cfefecc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:34:54.943 7fb2cfefecc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:34:54.943 7fb2cfefecc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:34:54.944 7fb2cfefecc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:54.944 7fb2cfefecc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:54.944 7fb2cfefecc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:54.944 7fb2cfefecc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:54.944 7fb2cfefecc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:34:54.944 7fb2cfefecc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:54.945 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-k8s-1454-1'], 'obj_dict': {'config_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-juju-k8s-1454-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-k8s-1454-1'], 'id_perms': {'created': '2025-09-01T01:34:54.934849', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:54.934849', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11050905052042072441, 'uuid_mslong': 16245146586780484127}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e1725ac0-0d33-421f-995c-b39839899179'}, 'oper': 'CREATE', 'request-id': 'req-77d95627-86ba-4107-afa8-8d753536bb23', 'type': 'config_node', 'uuid': 'e1725ac0-0d33-421f-995c-b39839899179'} 09/01/2025 01:34:54.945 7fb2d46019a0 [contrail-device-manager] [ERROR]: Error in rabbitmq drainer greenlet: 'DeviceManagerLogger' object has no attribute 'warn' 09/01/2025 01:34:54.945 7fb2d46019a0 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:34:54.946 7fb2d4601900 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:54.946 7fb2d4601900 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:54.946 7fb2d4601900 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:54.955 7fb2d46019a0 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:34:54.955 7fb2d46015e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:54.955 7fb2d46015e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:54.955 7fb2d46015e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.392 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default'], 'obj_dict': {'display_name': 'k8s-default', 'fq_name': ['default-domain', 'k8s-default'], 'id_perms': {'created': '2025-09-01T01:34:55.387855', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:55.387855', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11357663924834040824, 'uuid_mslong': 10386380444838743678}}, 'parent_type': 'domain', 'parent_uuid': 'ce056a4b-12ea-41a5-896d-393d506f2011', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8'}, 'oper': 'CREATE', 'request-id': 'req-bd191f7e-5bc6-4e0b-b0dc-2d406720360c', 'type': 'project', 'uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8'} 09/01/2025 01:34:55.393 7fb2d46019a0 [contrail-device-manager] [ERROR]: Error in rabbitmq drainer greenlet: 'DeviceManagerLogger' object has no attribute 'warn' 09/01/2025 01:34:55.393 7fb2d46019a0 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:34:55.393 7fb2d4601400 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.393 7fb2d4601400 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:55.393 7fb2d4601400 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.399 7fb2d46019a0 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:34:55.399 7fb2d4601400 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.400 7fb2d4601400 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:55.400 7fb2d4601400 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.424 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'display_name': 'default-application-policy-set', 'fq_name': ['default-domain', 'k8s-default', 'default-application-policy-set'], 'id_perms': {'created': '2025-09-01T01:34:55.418880', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:55.418880', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12899231214931829714, 'uuid_mslong': 17526535842386496605}}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'f33ac37d-3499-4c5d-b303-467269a463d2'}, 'oper': 'CREATE', 'request-id': 'req-bd191f7e-5bc6-4e0b-b0dc-2d406720360c', 'type': 'application_policy_set', 'uuid': 'f33ac37d-3499-4c5d-b303-467269a463d2'} 09/01/2025 01:34:55.426 7fb2d46019a0 [contrail-device-manager] [ERROR]: Error in rabbitmq drainer greenlet: 'DeviceManagerLogger' object has no attribute 'warn' 09/01/2025 01:34:55.426 7fb2d46019a0 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:34:55.426 7fb2d4601360 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.426 7fb2d4601360 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:55.426 7fb2d4601360 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.431 7fb2d46019a0 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:34:55.431 7fb2cfefecc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.432 7fb2cfefecc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:55.432 7fb2cfefecc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.447 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default'], 'oper': 'UPDATE', 'request-id': 'req-bd191f7e-5bc6-4e0b-b0dc-2d406720360c', 'type': 'project', 'uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8'} 09/01/2025 01:34:55.447 7fb2d46019a0 [contrail-device-manager] [ERROR]: Error in rabbitmq drainer greenlet: 'DeviceManagerLogger' object has no attribute 'warn' 09/01/2025 01:34:55.447 7fb2d46019a0 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:34:55.448 7fb2cfefecc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.448 7fb2cfefecc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:34:55.448 7fb2cfefecc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.457 7fb2d46019a0 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:34:55.457 7fb2d4601900 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.458 7fb2d4601900 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:55.458 7fb2d4601900 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:55.541 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'default'], 'obj_dict': {'display_name': 'default', 'fq_name': ['default-domain', 'k8s-default', 'default'], 'id_perms': {'created': '2025-09-01T01:34:55.484361', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:34:55.484361', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11936403218885516667, 'uuid_mslong': 6540726343857162531}}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'a9777858-b10b-4f90-ae9a-ee86bb4e8bb1', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-default:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'a0ce129a-72d1-4990-8cd9-2cadac31ddea', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-default:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'f588a086-f096-477b-bc3b-6a0e980ef7ed', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '332d697a-4608-42c5-bfb1-5aa301238183', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000002, 'uuid': '5ac553f4-9aa5-4923-a5a6-9f7c5d801d7b'}, 'oper': 'CREATE', 'request-id': 'req-87bead24-6f46-492a-b835-8fdf789d0ce8', 'type': 'security_group', 'uuid': '5ac553f4-9aa5-4923-a5a6-9f7c5d801d7b'} 09/01/2025 01:34:55.617 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'default', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000002', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'a9777858-b10b-4f90-ae9a-ee86bb4e8bb1'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000002', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'a0ce129a-72d1-4990-8cd9-2cadac31ddea'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-default', 'default', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:34:55.565399', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:55.565399', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12393600091174732163, 'uuid_mslong': 5435922950334663122}}, 'parent_type': 'security-group', 'parent_uuid': '5ac553f4-9aa5-4923-a5a6-9f7c5d801d7b', 'perms2': {'global_access': 0, 'owner': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'owner_access': 7, 'share': []}, 'uuid': '4b70471f-6117-49d2-abfe-e99e6ab80183'}, 'oper': 'CREATE', 'request-id': 'req-1aaa4255-fd97-4aa1-8586-a82862deafbe', 'type': 'access_control_list', 'uuid': '4b70471f-6117-49d2-abfe-e99e6ab80183'} 09/01/2025 01:34:55.654 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg'], 'obj_dict': {'display_name': 'k8s-default-default-sg', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg'], 'id_perms': {'created': '2025-09-01T01:34:55.649202', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:34:55.649202', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13595223614054563807, 'uuid_mslong': 5613512272088154649}}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': []}, 'security_group_id': 8000003, 'uuid': '4de733ab-781c-4219-bcab-efd8adb97fdf'}, 'oper': 'CREATE', 'request-id': 'req-862169ea-8f04-4eb4-b8a9-323bb8eb9c3a', 'type': 'security_group', 'uuid': '4de733ab-781c-4219-bcab-efd8adb97fdf'} 09/01/2025 01:34:55.656 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:55.729 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'default', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'f588a086-f096-477b-bc3b-6a0e980ef7ed'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '332d697a-4608-42c5-bfb1-5aa301238183'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-default', 'default', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:34:55.667490', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:55.667490', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13388604008182575585, 'uuid_mslong': 7374738075550172945}}, 'parent_type': 'security-group', 'parent_uuid': '5ac553f4-9aa5-4923-a5a6-9f7c5d801d7b', 'perms2': {'global_access': 0, 'owner': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'owner_access': 7, 'share': []}, 'uuid': '66585534-e8b7-4711-b9cd-e068da17f1e1'}, 'oper': 'CREATE', 'request-id': 'req-dc2a2ba5-0558-47fa-ae44-cc96394be8fc', 'type': 'access_control_list', 'uuid': '66585534-e8b7-4711-b9cd-e068da17f1e1'} 09/01/2025 01:34:55.741 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-8e1185cb-738d-413f-9236-17f30c42c65b', 'type': 'security_group', 'uuid': '4de733ab-781c-4219-bcab-efd8adb97fdf'} 09/01/2025 01:34:55.827 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:34:55.820914', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:55.820914', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10221026790512302696, 'uuid_mslong': 724960809861532916}}, 'parent_type': 'security-group', 'parent_uuid': '4de733ab-781c-4219-bcab-efd8adb97fdf', 'perms2': {'global_access': 0, 'owner': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'owner_access': 7, 'share': []}, 'uuid': '0a0f9403-fbe0-4cf4-8dd8-61b6703c9a68'}, 'oper': 'CREATE', 'request-id': 'req-54de4dcc-5324-4370-98b0-d85f92399627', 'type': 'access_control_list', 'uuid': '0a0f9403-fbe0-4cf4-8dd8-61b6703c9a68'} 09/01/2025 01:34:55.842 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'obj_dict': {'display_name': 'k8s', 'fq_name': ['default-policy-management', 'k8s'], 'id_perms': {'created': '2025-09-01T01:34:55.834723', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:55.834723', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12603312532585330301, 'uuid_mslong': 1917128780955733221}}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'}, 'oper': 'CREATE', 'request-id': 'req-a0620321-560d-4dab-b586-65ca6b69f87f', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:55.868 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:34:55.857136', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:55.857136', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10774130541549910497, 'uuid_mslong': 16845570577868801345}}, 'parent_type': 'security-group', 'parent_uuid': '4de733ab-781c-4219-bcab-efd8adb97fdf', 'perms2': {'global_access': 0, 'owner': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'owner_access': 7, 'share': []}, 'uuid': 'e9c77d30-5ca4-4541-9585-66a4ccc4f9e1'}, 'oper': 'CREATE', 'request-id': 'req-7f692d85-96b4-4f98-8275-a07a203ce93c', 'type': 'access_control_list', 'uuid': 'e9c77d30-5ca4-4541-9585-66a4ccc4f9e1'} 09/01/2025 01:34:55.897 7fb2d4601680 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:34:55.917 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-eef11707-29e3-4fad-9cd7-903ad0babe99', 'type': 'global_vrouter_config', 'uuid': '87a687b0-9781-4994-aa87-dbc3f38997c0'} 09/01/2025 01:34:55.989 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'obj_dict': {'display_name': 'k8s-kube-system', 'fq_name': ['default-domain', 'k8s-kube-system'], 'id_perms': {'created': '2025-09-01T01:34:55.985402', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:55.985402', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10013454790172241632, 'uuid_mslong': 11951427749879825585}}, 'parent_type': 'domain', 'parent_uuid': 'ce056a4b-12ea-41a5-896d-393d506f2011', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'}, 'oper': 'CREATE', 'request-id': 'req-41dd65dc-f795-45e5-a745-6d1962e85f36', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:34:56.017 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'display_name': 'default-application-policy-set', 'fq_name': ['default-domain', 'k8s-kube-system', 'default-application-policy-set'], 'id_perms': {'created': '2025-09-01T01:34:56.012086', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.012086', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10948140934525109059, 'uuid_mslong': 17021587060483244415}}, 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'ec38d33f-4d7d-417f-97ef-9c2c99484343'}, 'oper': 'CREATE', 'request-id': 'req-41dd65dc-f795-45e5-a745-6d1962e85f36', 'type': 'application_policy_set', 'uuid': 'ec38d33f-4d7d-417f-97ef-9c2c99484343'} 09/01/2025 01:34:56.043 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-41dd65dc-f795-45e5-a745-6d1962e85f36', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:34:56.299 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'default'], 'obj_dict': {'display_name': 'default', 'fq_name': ['default-domain', 'k8s-kube-system', 'default'], 'id_perms': {'created': '2025-09-01T01:34:56.235704', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:34:56.235704', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11024785080048304205, 'uuid_mslong': 14009118518343257964}}, 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '0343e44d-b0e1-4539-8c19-d2156da9cc62', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-kube-system:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'a92a8a05-b289-4b87-89c3-98c0865faf30', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-kube-system:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '9cd8ca77-a919-448f-88f9-6db9c556a8f1', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '5f74e63a-1bb1-40ad-9d17-b59bdd9d5719', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000004, 'uuid': 'c26a6311-a632-4f6c-98ff-e79e554e404d'}, 'oper': 'CREATE', 'request-id': 'req-4a0481de-ef18-4672-b4dd-de9aaa349670', 'type': 'security_group', 'uuid': 'c26a6311-a632-4f6c-98ff-e79e554e404d'} 09/01/2025 01:34:56.354 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg'], 'obj_dict': {'display_name': 'k8s-kube-system-default-sg', 'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg'], 'id_perms': {'created': '2025-09-01T01:34:56.343303', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:34:56.343303', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11198606753506992789, 'uuid_mslong': 16211337997743114230}}, 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': []}, 'security_group_id': 8000005, 'uuid': 'e0fa3e04-8145-47f6-9b69-718272132295'}, 'oper': 'CREATE', 'request-id': 'req-ccd58c30-7b81-4365-9b61-97e54a8c03ce', 'type': 'security_group', 'uuid': 'e0fa3e04-8145-47f6-9b69-718272132295'} 09/01/2025 01:34:56.406 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'default', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000004', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '0343e44d-b0e1-4539-8c19-d2156da9cc62'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000004', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'a92a8a05-b289-4b87-89c3-98c0865faf30'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-system', 'default', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:34:56.357752', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.357752', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13076623060756524689, 'uuid_mslong': 3924770634606397527}}, 'parent_type': 'security-group', 'parent_uuid': 'c26a6311-a632-4f6c-98ff-e79e554e404d', 'perms2': {'global_access': 0, 'owner': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'owner_access': 7, 'share': []}, 'uuid': '36779619-0c99-4857-b579-7f640e12ee91'}, 'oper': 'CREATE', 'request-id': 'req-88880579-f6ed-40c8-8e6d-21e041eb2eac', 'type': 'access_control_list', 'uuid': '36779619-0c99-4857-b579-7f640e12ee91'} 09/01/2025 01:34:56.434 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-240070e3-47f5-4369-b66e-571fc8a75cef', 'type': 'security_group', 'uuid': 'e0fa3e04-8145-47f6-9b69-718272132295'} 09/01/2025 01:34:56.508 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'default', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '9cd8ca77-a919-448f-88f9-6db9c556a8f1'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '5f74e63a-1bb1-40ad-9d17-b59bdd9d5719'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-system', 'default', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:34:56.457597', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.457597', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11506460743523033639, 'uuid_mslong': 6215132166285246947}}, 'parent_type': 'security-group', 'parent_uuid': 'c26a6311-a632-4f6c-98ff-e79e554e404d', 'perms2': {'global_access': 0, 'owner': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'owner_access': 7, 'share': []}, 'uuid': '564095c6-ab89-41e3-9faf-291517aae227'}, 'oper': 'CREATE', 'request-id': 'req-ac8f95ef-cfd2-4c90-b51d-d56b104064e6', 'type': 'access_control_list', 'uuid': '564095c6-ab89-41e3-9faf-291517aae227'} 09/01/2025 01:34:56.525 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-ip-fabric-ipam'], 'obj_dict': {'display_name': 'k8s-ip-fabric-ipam', 'fq_name': ['default-domain', 'k8s-default', 'k8s-ip-fabric-ipam'], 'id_perms': {'created': '2025-09-01T01:34:56.516615', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.516615', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12876161066528670497, 'uuid_mslong': 14866473943478387208}}, 'ipam_subnet_method': 'flat-subnet', 'ipam_subnets': {'subnets': [{'addr_from_start': None, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': '10.79.255.254', 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': '10.79.255.253', 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': '10.64.0.0', 'ip_prefix_len': 12}, 'subnet_name': None, 'subnet_uuid': None, 'subscriber_tag': None, 'vlan_tag': None}]}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'ce505349-1fa1-4208-b2b1-5044e9280321'}, 'oper': 'CREATE', 'request-id': 'req-91f7aff8-08b6-4a47-bbf5-4166f8477cc5', 'type': 'network_ipam', 'uuid': 'ce505349-1fa1-4208-b2b1-5044e9280321'} 09/01/2025 01:34:56.563 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-pod-ipam'], 'obj_dict': {'display_name': 'k8s-pod-ipam', 'fq_name': ['default-domain', 'k8s-default', 'k8s-pod-ipam'], 'id_perms': {'created': '2025-09-01T01:34:56.554258', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.554258', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10520340932493082396, 'uuid_mslong': 5725016635900381083}}, 'ipam_subnet_method': 'flat-subnet', 'ipam_subnets': {'subnets': [{'addr_from_start': None, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': '10.47.255.254', 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': '10.47.255.253', 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': '10.32.0.0', 'ip_prefix_len': 12}, 'subnet_name': None, 'subnet_uuid': None, 'subscriber_tag': None, 'vlan_tag': None}]}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '4f73584c-440b-479b-91ff-c256c5407f1c'}, 'oper': 'CREATE', 'request-id': 'req-407f4093-370d-4446-804c-7616fae2fc43', 'type': 'network_ipam', 'uuid': '4f73584c-440b-479b-91ff-c256c5407f1c'} 09/01/2025 01:34:56.588 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:34:56.581158', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.581158', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9762737177291075290, 'uuid_mslong': 2998260824958910946}}, 'parent_type': 'security-group', 'parent_uuid': 'e0fa3e04-8145-47f6-9b69-718272132295', 'perms2': {'global_access': 0, 'owner': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'owner_access': 7, 'share': []}, 'uuid': '299bf655-b7a5-41e2-877c-35bccfef2eda'}, 'oper': 'CREATE', 'request-id': 'req-9f39a7cb-d7d5-4f96-bf25-7339bd7a5d2f', 'type': 'access_control_list', 'uuid': '299bf655-b7a5-41e2-877c-35bccfef2eda'} 09/01/2025 01:34:56.657 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:56.693 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'obj_dict': {'address_allocation_mode': 'flat-subnet-only', 'display_name': 'k8s-default-pod-network', 'fabric_snat': True, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'id_perms': {'created': '2025-09-01T01:34:56.642429', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.642429', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10518379392776784806, 'uuid_mslong': 15443089546972253873}}, 'is_shared': False, 'network_ipam_refs': [{'attr': {'host_routes': None, 'ipam_subnets': [{'subnet_uuid': 'eada5f2d-448e-4621-9fea-812925eb46e9'}]}, 'to': ['default-domain', 'k8s-default', 'k8s-pod-ipam'], 'uuid': '4f73584c-440b-479b-91ff-c256c5407f1c'}], 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6', 'virtual_network_network_id': 7, 'virtual_network_properties': {'allow_transit': None, 'forwarding_mode': 'l3', 'max_flows': 0, 'mirror_destination': False, 'mtu': None, 'network_id': None, 'rpf': None, 'vxlan_network_identifier': None}}, 'oper': 'CREATE', 'request-id': 'req-59aee991-1a94-429a-b425-b319a40967e8', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:34:56.721 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:34:56.692301', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.692301', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11196397370808665147, 'uuid_mslong': 4939850386392500102}}, 'parent_type': 'security-group', 'parent_uuid': 'e0fa3e04-8145-47f6-9b69-718272132295', 'perms2': {'global_access': 0, 'owner': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'owner_access': 7, 'share': []}, 'uuid': '448ddfc1-0480-4786-9b61-9816732b043b'}, 'oper': 'CREATE', 'request-id': 'req-226d9218-d6e4-44e4-8425-5c01a5bf858b', 'type': 'access_control_list', 'uuid': '448ddfc1-0480-4786-9b61-9816732b043b'} 09/01/2025 01:34:56.755 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'obj_dict': {'display_name': 'k8s-default-pod-network', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'id_perms': {'created': '2025-09-01T01:34:56.741593', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.741593', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9857280386579676206, 'uuid_mslong': 6892182549909753541}}, 'parent_type': 'virtual-network', 'parent_uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': True, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'}, 'oper': 'CREATE', 'request-id': 'req-59aee991-1a94-429a-b425-b319a40967e8', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:34:56.864 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-pod-network'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-pod-network'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-pod-network'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-pod-network'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'k8s-default-pod-network', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'id_perms': {'created': '2025-09-01T01:34:56.808303', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.808303', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12634401716669227668, 'uuid_mslong': 9014006186852894039}}, 'parent_type': 'virtual-network', 'parent_uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '7d182ede-628a-4557-af56-696bdfa7a294'}, 'oper': 'CREATE', 'request-id': 'req-1c8d35d4-fa79-4b1e-be60-502b66b7db78', 'type': 'access_control_list', 'uuid': '7d182ede-628a-4557-af56-696bdfa7a294'} 09/01/2025 01:34:56.898 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000004'], 'obj_dict': {'display_name': 'target:64512:8000004', 'fq_name': ['target:64512:8000004'], 'id_perms': {'created': '2025-09-01T01:34:56.891155', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.891155', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13143918234955476838, 'uuid_mslong': 13547113033425112061}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bc010387-395e-4bfd-b668-93fec74cef66'}, 'oper': 'CREATE', 'request-id': 'req-32a5bfe9-d020-47b3-8268-e0dcf80f619e', 'type': 'route_target', 'uuid': 'bc010387-395e-4bfd-b668-93fec74cef66'} 09/01/2025 01:34:56.919 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-service-ipam'], 'obj_dict': {'display_name': 'k8s-service-ipam', 'fq_name': ['default-domain', 'k8s-default', 'k8s-service-ipam'], 'id_perms': {'created': '2025-09-01T01:34:56.901828', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:56.901828', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10632512379082133835, 'uuid_mslong': 17731803175260668569}}, 'ipam_subnet_method': 'flat-subnet', 'ipam_subnets': {'subnets': [{'addr_from_start': None, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': '10.111.255.254', 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': '10.111.255.253', 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': '10.96.0.0', 'ip_prefix_len': 12}, 'subnet_name': None, 'subnet_uuid': None, 'subscriber_tag': None, 'vlan_tag': None}]}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'f614050a-708e-4299-938e-45ace122514b'}, 'oper': 'CREATE', 'request-id': 'req-c80b4929-fcc0-4eb7-96d7-1f51333b6e1a', 'type': 'network_ipam', 'uuid': 'f614050a-708e-4299-938e-45ace122514b'} 09/01/2025 01:34:56.954 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-e7ae3a1d-9b1b-4bd4-be39-41c1c5a4cdc5', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:34:57.014 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-fec8e9ff-0f7e-4854-abee-9b44fc1073dc', 'type': 'access_control_list', 'uuid': '7d182ede-628a-4557-af56-696bdfa7a294'} 09/01/2025 01:34:57.097 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'obj_dict': {'address_allocation_mode': 'flat-subnet-only', 'display_name': 'k8s-default-service-network', 'fabric_snat': False, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'id_perms': {'created': '2025-09-01T01:34:57.045929', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:57.045929', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11820567914732569193, 'uuid_mslong': 12016753917161719144}}, 'is_shared': False, 'network_ipam_refs': [{'attr': {'host_routes': None, 'ipam_subnets': [{'subnet_uuid': 'cdf5a7bb-3fee-45f9-9299-6a9e2ef0e400'}]}, 'to': ['default-domain', 'k8s-default', 'k8s-service-ipam'], 'uuid': 'f614050a-708e-4299-938e-45ace122514b'}], 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269', 'virtual_network_network_id': 8, 'virtual_network_properties': {'allow_transit': None, 'forwarding_mode': 'l3', 'max_flows': 0, 'mirror_destination': False, 'mtu': None, 'network_id': None, 'rpf': None, 'vxlan_network_identifier': None}}, 'oper': 'CREATE', 'request-id': 'req-232d5b26-5459-4cd8-acd5-13056167b54e', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:34:57.136 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'obj_dict': {'display_name': 'k8s-default-service-network', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'id_perms': {'created': '2025-09-01T01:34:57.129557', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:57.129557', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10058874526549187742, 'uuid_mslong': 11572430850722186631}}, 'parent_type': 'virtual-network', 'parent_uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'}, 'oper': 'CREATE', 'request-id': 'req-232d5b26-5459-4cd8-acd5-13056167b54e', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:34:57.176 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000005'], 'obj_dict': {'display_name': 'target:64512:8000005', 'fq_name': ['target:64512:8000005'], 'id_perms': {'created': '2025-09-01T01:34:57.170046', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:57.170046', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13218141680492412823, 'uuid_mslong': 12160149632363022162}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a8c187a9-d498-4752-b770-45d36088ff97'}, 'oper': 'CREATE', 'request-id': 'req-c62be96c-759a-46f4-a171-07ccd4bfb462', 'type': 'route_target', 'uuid': 'a8c187a9-d498-4752-b770-45d36088ff97'} 09/01/2025 01:34:57.195 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-565d0cba-c30e-48eb-aea3-a2632f8f2e7a', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:34:57.232 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-ip-fabric-np'], 'obj_dict': {'display_name': 'k8s-default-ip-fabric-np', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-ip-fabric-np'], 'id_perms': {'created': '2025-09-01T01:34:57.224637', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:57.224637', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9820500363855709707, 'uuid_mslong': 6871729834595271054}}, 'network_policy_entries': {'policy_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'application': [], 'created': None, 'description': None, 'direction': '<>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}], 'dst_ports': [{'end_port': -1, 'start_port': -1}], 'ethertype': None, 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '8f3cc2a6-3f21-40bd-9cf8-07332875b75a', 'src_addresses': [{'network_policy': 'default-domain:k8s-default:k8s-default-ip-fabric-np', 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': -1, 'start_port': -1}]}]}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '5f5d49e0-6781-418e-8849-6d0cb836c60b'}, 'oper': 'CREATE', 'request-id': 'req-e1542e63-440c-4bfd-bd1d-9ed52a8104eb', 'type': 'network_policy', 'uuid': '5f5d49e0-6781-418e-8849-6d0cb836c60b'} 09/01/2025 01:34:57.304 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-np'], 'obj_dict': {'display_name': 'k8s-default-service-np', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-np'], 'id_perms': {'created': '2025-09-01T01:34:57.294843', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:57.294843', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12937301099142653850, 'uuid_mslong': 11970738815292819317}}, 'network_policy_entries': {'policy_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'application': [], 'created': None, 'description': None, 'direction': '<>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-service-network'}], 'dst_ports': [{'end_port': -1, 'start_port': -1}], 'ethertype': None, 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '2cc90ab6-4fd1-4d50-8836-f841cc9e0762', 'src_addresses': [{'network_policy': 'default-domain:k8s-default:k8s-default-service-np', 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': -1, 'start_port': -1}]}]}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'a6209b87-6082-4775-b38a-86ce0eab279a'}, 'oper': 'CREATE', 'request-id': 'req-734b6617-5e04-4ff6-99ab-f28409d88552', 'type': 'network_policy', 'uuid': 'a6209b87-6082-4775-b38a-86ce0eab279a'} 09/01/2025 01:34:57.347 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-service-np'], 'obj_dict': {'display_name': 'k8s-default-pod-service-np', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-service-np'], 'id_perms': {'created': '2025-09-01T01:34:57.336300', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:57.336300', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9434725081410064776, 'uuid_mslong': 2241212454514476764}}, 'network_policy_entries': {'policy_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'application': [], 'created': None, 'description': None, 'direction': '<>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-service-network'}], 'dst_ports': [{'end_port': -1, 'start_port': -1}], 'ethertype': None, 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '629589cc-223a-407e-a160-df2b0b524fff', 'src_addresses': [{'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-pod-network'}], 'src_ports': [{'end_port': -1, 'start_port': -1}]}]}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '1f1a62da-5984-46dc-82ee-e07966ea5188'}, 'oper': 'CREATE', 'request-id': 'req-104165ae-0cd3-4d5b-9ae2-ca203fee1e4e', 'type': 'network_policy', 'uuid': '1f1a62da-5984-46dc-82ee-e07966ea5188'} 09/01/2025 01:34:57.408 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'default-project', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-21093259-5a40-4df3-bbb7-8edf25d90339', 'type': 'virtual_network', 'uuid': 'e07e6e04-4e93-4043-ab83-32b8f8854bbe'} 09/01/2025 01:34:57.443 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-b1969f07-11f0-4f5a-acfd-26d748871cb4', 'type': 'access_control_list', 'uuid': 'a87aabc0-ac59-4e06-a71b-5e1b9d1a40ce'} 09/01/2025 01:34:57.450 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-21093259-5a40-4df3-bbb7-8edf25d90339', 'type': 'routing_instance', 'uuid': '23054292-38bc-4b6f-b5fa-0f8021a7362f'} 09/01/2025 01:34:57.493 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-780f1e29-426f-4c8a-95bd-66a39eb92d4d', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:34:57.521 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-1b6a50f4-d11d-4775-8b07-24c851eab479', 'type': 'access_control_list', 'uuid': 'a87aabc0-ac59-4e06-a71b-5e1b9d1a40ce'} 09/01/2025 01:34:57.528 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-k8s-1454-1'], 'obj_dict': {'config_database_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-juju-k8s-1454-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-k8s-1454-1'], 'id_perms': {'created': '2025-09-01T01:34:57.511328', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:57.511328', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10288526971317814616, 'uuid_mslong': 9619987740220280603}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '85810fe1-7f71-4f1b-8ec8-30c4fb6c8558'}, 'oper': 'CREATE', 'request-id': 'req-bc40be73-7cda-43db-bf51-5d88a64adeb5', 'type': 'config_database_node', 'uuid': '85810fe1-7f71-4f1b-8ec8-30c4fb6c8558'} 09/01/2025 01:34:57.545 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-780f1e29-426f-4c8a-95bd-66a39eb92d4d', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:34:57.615 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-63d9d2e6-ba1a-4d0d-8a27-1157f1443220', 'type': 'access_control_list', 'uuid': '7d182ede-628a-4557-af56-696bdfa7a294'} 09/01/2025 01:34:57.632 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-ed81ae90-4f21-4fc8-85dc-fb2d26a6f954', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:34:57.644 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-f01d4e77-4220-4d4d-b01b-775c7abb911e', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:34:57.656 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-f01d4e77-4220-4d4d-b01b-775c7abb911e', 'type': 'routing_instance', 'uuid': '23054292-38bc-4b6f-b5fa-0f8021a7362f'} 09/01/2025 01:34:57.658 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:57.693 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-ed81ae90-4f21-4fc8-85dc-fb2d26a6f954', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:34:57.703 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-37941629-f84d-418f-9a40-ad7b740bf2eb', 'type': 'access_control_list', 'uuid': '7d182ede-628a-4557-af56-696bdfa7a294'} 09/01/2025 01:34:57.776 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-7513ce5c-b4bf-4702-9bf3-443ac5b9bfb9', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:34:57.804 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-7513ce5c-b4bf-4702-9bf3-443ac5b9bfb9', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:34:57.808 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-93c437c6-6633-4b6e-a8ae-a1e511faedc6', 'type': 'access_control_list', 'uuid': 'a87aabc0-ac59-4e06-a71b-5e1b9d1a40ce'} 09/01/2025 01:34:57.850 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-66ce2b60-91ef-454f-92d1-0a96443b837e', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:34:57.859 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': -1, 'start_port': -1}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-service-network'}, 'src_port': {'end_port': -1, 'start_port': -1}}, 'rule_uuid': '8f3cc2a6-3f21-40bd-9cf8-07332875b75a'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-service-network'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:k8s-default:k8s-default-service-network'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'k8s-default-service-network', 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'id_perms': {'created': '2025-09-01T01:34:57.838228', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:57.838228', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9688595357425536257, 'uuid_mslong': 962755083897160870}}, 'parent_type': 'virtual-network', 'parent_uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '0d5c64a5-dd64-44a6-8674-ce252bd90d01'}, 'oper': 'CREATE', 'request-id': 'req-0a977f31-731a-4fd1-a5df-e760cf5106de', 'type': 'access_control_list', 'uuid': '0d5c64a5-dd64-44a6-8674-ce252bd90d01'} 09/01/2025 01:34:57.907 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-1d8b72b9-3623-4b84-9199-10245016ba49', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:34:57.910 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-1d8b72b9-3623-4b84-9199-10245016ba49', 'type': 'routing_instance', 'uuid': '23054292-38bc-4b6f-b5fa-0f8021a7362f'} 09/01/2025 01:34:57.922 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-66ce2b60-91ef-454f-92d1-0a96443b837e', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:34:57.951 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-852aa536-24e0-4a8c-b109-95a6f9a39b58', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:34:58.005 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-6395e580-30d8-495c-ac31-7bebb8e20dad', 'type': 'access_control_list', 'uuid': '0d5c64a5-dd64-44a6-8674-ce252bd90d01'} 09/01/2025 01:34:58.029 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-852aa536-24e0-4a8c-b109-95a6f9a39b58', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:34:58.039 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-5ea10595-094d-412f-bbae-a518ae5ea01c', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:34:58.051 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-5ea10595-094d-412f-bbae-a518ae5ea01c', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:34:58.278 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-denyall'], 'obj_dict': {'display_name': 'k8s-denyall', 'fq_name': ['default-policy-management', 'k8s-denyall'], 'id_perms': {'created': '2025-09-01T01:34:58.269037', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:58.269037', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9281677744765653977, 'uuid_mslong': 16276300850529848719}}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e1e10963-5538-4d8f-80cf-24bb8067d3d9'}, 'oper': 'CREATE', 'request-id': 'req-013bb0d9-3a7e-4f51-9114-ec4159349c3c', 'type': 'firewall_policy', 'uuid': 'e1e10963-5538-4d8f-80cf-24bb8067d3d9'} 09/01/2025 01:34:58.338 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-denyall'], 'oper': 'UPDATE', 'request-id': 'req-51c82e2c-a312-42d1-b532-2aa30f0232b1', 'type': 'firewall_policy', 'uuid': 'e1e10963-5538-4d8f-80cf-24bb8067d3d9'} 09/01/2025 01:34:58.451 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-bccd7199-869c-49f9-bc42-a24d93d7a01e', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:58.616 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'obj_dict': {'display_name': 'k8s-allowall', 'fq_name': ['default-policy-management', 'k8s-allowall'], 'id_perms': {'created': '2025-09-01T01:34:58.612519', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:58.612519', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11791485297466611927, 'uuid_mslong': 12591360059846116675}}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'}, 'oper': 'CREATE', 'request-id': 'req-eacc1f31-9300-4f08-9293-9539003f9be2', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:34:58.659 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:58.692 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-1f44f737-0863-4947-b5c3-f31c406646c1', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:34:58.840 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-c6b60776-7032-491d-a74d-53aa89fe5a38', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:58.876 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-7b527ba4-12f9-4141-957d-e71ac80e0977', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:58.914 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-7c6f2258-bcda-4d16-9dba-264fa9d38c4e', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:58.943 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:34:58.944 7fb2d4601cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:34:58.944 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:34:58.944 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:34:58.944 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:34:58.944 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:34:58.944 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:34:58.945 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:34:58.945 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:58.945 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:34:58.945 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:58.945 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:58.945 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:34:58.945 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:34:59.050 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Ingress'], 'obj_dict': {'display_name': 'k8s-Ingress', 'fq_name': ['default-policy-management', 'k8s-Ingress'], 'id_perms': {'created': '2025-09-01T01:34:59.040105', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:59.040105', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10188735552209959056, 'uuid_mslong': 7715603300617307372}}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6b135452-a920-44ec-8d65-a900a3de3890'}, 'oper': 'CREATE', 'request-id': 'req-c0edc76c-a3f8-449f-b64c-b3aad4442d98', 'type': 'firewall_policy', 'uuid': '6b135452-a920-44ec-8d65-a900a3de3890'} 09/01/2025 01:34:59.081 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Ingress'], 'oper': 'UPDATE', 'request-id': 'req-c7a474ad-d2ab-43c0-a434-7c283897e862', 'type': 'firewall_policy', 'uuid': '6b135452-a920-44ec-8d65-a900a3de3890'} 09/01/2025 01:34:59.271 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-5d95b5ce-064e-4fb8-a834-2b173c32b6cb', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:59.333 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-206b120c-3131-4ae7-8935-b0755f77ee9f', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:59.365 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-3444dad5-67b5-4b4c-8fcc-0d82e1938fe5', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:59.435 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-80f3d144-97b9-4630-ab6d-f6c12edc818a', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:59.528 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-95997700-60ae-48d9-9394-8ef1de58aca0', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:59.660 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:34:59.743 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['application=k8s'], 'obj_dict': {'display_name': 'application=k8s', 'fq_name': ['application=k8s'], 'id_perms': {'created': '2025-09-01T01:34:59.735253', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:59.735253', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11942659685020229637, 'uuid_mslong': 2992592746691382189}}, 'name': 'application=k8s', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x00010000', 'tag_type_name': 'application', 'tag_type_refs': [{'to': ['application'], 'uuid': 'd092075d-9887-4533-9bdd-86b77d6c3c87'}], 'tag_value': 'k8s', 'uuid': '2987d33f-67f3-4bad-a5bc-d9b567026005'}, 'oper': 'CREATE', 'request-id': 'req-74ba4f4e-fe97-4ec0-bfd1-f8040e55371b', 'type': 'tag', 'uuid': '2987d33f-67f3-4bad-a5bc-d9b567026005'} 09/01/2025 01:34:59.839 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s'], 'oper': 'UPDATE', 'request-id': 'req-4d9bbb9e-f9da-425a-a88c-ad9a8d083f2b', 'type': 'application_policy_set', 'uuid': '1a9b0278-098b-4ce5-aee7-f5f921fa367d'} 09/01/2025 01:34:59.940 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['k8s-app'], 'obj_dict': {'display_name': 'k8s-app', 'fq_name': ['k8s-app'], 'id_perms': {'created': '2025-09-01T01:34:59.932934', 'creator': None, 'description': None, 'enable': None, 'last_modified': '2025-09-01T01:34:59.932934', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 13013349798405736565, 'uuid_mslong': 6378882733062310404}}, 'name': 'k8s-app', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x00ff', 'uuid': '5886580c-880d-4a04-b498-b4b1a7e00875'}, 'oper': 'CREATE', 'request-id': 'req-dd1a0a6b-707c-4067-8461-f611ba652626', 'type': 'tag_type', 'uuid': '5886580c-880d-4a04-b498-b4b1a7e00875'} 09/01/2025 01:34:59.968 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['k8s-app=kube-dns'], 'obj_dict': {'display_name': 'k8s-app=kube-dns', 'fq_name': ['k8s-app=kube-dns'], 'id_perms': {'created': '2025-09-01T01:34:59.959558', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:34:59.959558', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11471135153113387167, 'uuid_mslong': 7836802123086514403}}, 'name': 'k8s-app=kube-dns', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x00ff0000', 'tag_type_name': 'k8s-app', 'tag_type_refs': [{'to': ['k8s-app'], 'uuid': '5886580c-880d-4a04-b498-b4b1a7e00875'}], 'tag_value': 'kube-dns', 'uuid': '6cc1ea02-8199-48e3-9f31-a8a523d1d09f'}, 'oper': 'CREATE', 'request-id': 'req-dd1a0a6b-707c-4067-8461-f611ba652626', 'type': 'tag', 'uuid': '6cc1ea02-8199-48e3-9f31-a8a523d1d09f'} 09/01/2025 01:35:00.062 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['pod-template-hash'], 'obj_dict': {'display_name': 'pod-template-hash', 'fq_name': ['pod-template-hash'], 'id_perms': {'created': '2025-09-01T01:35:00.054172', 'creator': None, 'description': None, 'enable': None, 'last_modified': '2025-09-01T01:35:00.054172', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 11925374521531939020, 'uuid_mslong': 7275911611303085316}}, 'name': 'pod-template-hash', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0100', 'uuid': '64f93b0f-a0dc-4504-a57f-70f1a967b8cc'}, 'oper': 'CREATE', 'request-id': 'req-ecafa1a4-ff9e-46b3-91a7-b2758a53c848', 'type': 'tag_type', 'uuid': '64f93b0f-a0dc-4504-a57f-70f1a967b8cc'} 09/01/2025 01:35:00.093 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['pod-template-hash=6f867cd986'], 'obj_dict': {'display_name': 'pod-template-hash=6f867cd986', 'fq_name': ['pod-template-hash=6f867cd986'], 'id_perms': {'created': '2025-09-01T01:35:00.081848', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:00.081848', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13788021986930285393, 'uuid_mslong': 6374837122979416772}}, 'name': 'pod-template-hash=6f867cd986', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01000000', 'tag_type_name': 'pod-template-hash', 'tag_type_refs': [{'to': ['pod-template-hash'], 'uuid': '64f93b0f-a0dc-4504-a57f-70f1a967b8cc'}], 'tag_value': '6f867cd986', 'uuid': '5877f896-8829-4ac4-bf58-e4f1ee415b51'}, 'oper': 'CREATE', 'request-id': 'req-ecafa1a4-ff9e-46b3-91a7-b2758a53c848', 'type': 'tag', 'uuid': '5877f896-8829-4ac4-bf58-e4f1ee415b51'} 09/01/2025 01:35:00.188 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['namespace'], 'obj_dict': {'display_name': 'namespace', 'fq_name': ['namespace'], 'id_perms': {'created': '2025-09-01T01:35:00.184338', 'creator': None, 'description': None, 'enable': None, 'last_modified': '2025-09-01T01:35:00.184338', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 12142692889164708494, 'uuid_mslong': 9821876152153425061}}, 'name': 'namespace', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0101', 'uuid': '884e5052-64fc-44a5-a883-82d91352fa8e'}, 'oper': 'CREATE', 'request-id': 'req-c8d73cb7-47c0-47d5-a681-44a5a299ad3c', 'type': 'tag_type', 'uuid': '884e5052-64fc-44a5-a883-82d91352fa8e'} 09/01/2025 01:35:00.221 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['namespace=kube-system'], 'obj_dict': {'display_name': 'namespace=kube-system', 'fq_name': ['namespace=kube-system'], 'id_perms': {'created': '2025-09-01T01:35:00.212283', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:00.212283', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9786979529561711537, 'uuid_mslong': 3566125101318032622}}, 'name': 'namespace=kube-system', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01010000', 'tag_type_name': 'namespace', 'tag_type_refs': [{'to': ['namespace'], 'uuid': '884e5052-64fc-44a5-a883-82d91352fa8e'}], 'tag_value': 'kube-system', 'uuid': '317d6be2-b0aa-4cee-87d2-56074b8ba3b1'}, 'oper': 'CREATE', 'request-id': 'req-c8d73cb7-47c0-47d5-a681-44a5a299ad3c', 'type': 'tag', 'uuid': '317d6be2-b0aa-4cee-87d2-56074b8ba3b1'} 09/01/2025 01:35:00.243 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-2a369105-28c6-49cb-be5b-da7741b80510', 'type': 'global_vrouter_config', 'uuid': '87a687b0-9781-4994-aa87-dbc3f38997c0'} 09/01/2025 01:35:00.429 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-6d90e0f3-59f2-487e-b779-b1873bf72868', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:00.464 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['k8s__kube-system__coredns-6f867cd986-wlkqx'], 'obj_dict': {'display_name': 'k8s__kube-system__coredns-6f867cd986-wlkqx', 'fq_name': ['k8s__kube-system__coredns-6f867cd986-wlkqx'], 'id_perms': {'created': '2025-09-01T01:35:00.459243', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:00.459243', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12979318260264720552, 'uuid_mslong': 11863649037683543068}}, 'perms2': {'global_access': 0, 'owner': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'owner_access': 7, 'share': []}, 'server_type': 'container', 'uuid': 'a4a425f1-8708-4c1c-b41f-cd30b9d1d8a8'}, 'oper': 'CREATE', 'request-id': 'req-c7d91bb6-6d43-4eb5-a9e6-750581fac2d9', 'type': 'virtual_machine', 'uuid': 'a4a425f1-8708-4c1c-b41f-cd30b9d1d8a8'} 09/01/2025 01:35:00.491 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2025-09-01T01:35:00.482458', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.482458', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11541890835256865210, 'uuid_mslong': 5907038753012272917}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '51fa0472-f3c3-4f15-a02d-089027d271ba', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-7e298936-cd5c-4a6e-b167-019153a81134', 'type': 'alarm', 'uuid': '51fa0472-f3c3-4f15-a02d-089027d271ba'} 09/01/2025 01:35:00.499 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['k8s__kube-system__coredns-6f867cd986-wlkqx'], 'oper': 'UPDATE', 'request-id': 'req-785a52a2-faa6-404a-a42b-4d1b7282c546', 'type': 'virtual_machine', 'uuid': 'a4a425f1-8708-4c1c-b41f-cd30b9d1d8a8'} 09/01/2025 01:35:00.524 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2025-09-01T01:35:00.518275', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.518275', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13335252558768919498, 'uuid_mslong': 17592579791041153399}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f425661c-47b9-4977-b910-558c8b8a53ca', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-9ac55cb3-b339-4003-889d-4986b65d2c3c', 'type': 'alarm', 'uuid': 'f425661c-47b9-4977-b910-558c8b8a53ca'} 09/01/2025 01:35:00.602 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'coredns-6f867cd986-wlkqx__e02048c4-86d3-11f0-93e1-fa163e599e0d'], 'obj_dict': {'display_name': 'coredns-6f867cd986-wlkqx__e02048c4-86d3-11f0-93e1-fa163e599e0d', 'fq_name': ['default-domain', 'k8s-kube-system', 'coredns-6f867cd986-wlkqx__e02048c4-86d3-11f0-93e1-fa163e599e0d'], 'id_perms': {'created': '2025-09-01T01:35:00.522540', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:00.522540', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10656073166777589261, 'uuid_mslong': 16149988272663368176}}, 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'security_group_refs': [{'to': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg']}], 'uuid': 'e02048c4-86d3-11f0-93e1-fa163e599e0d', 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:e0:20:48:c4:86']}, 'virtual_machine_refs': [{'to': ['k8s__kube-system__coredns-6f867cd986-wlkqx'], 'uuid': 'a4a425f1-8708-4c1c-b41f-cd30b9d1d8a8'}], 'virtual_network_refs': [{'to': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'}]}, 'oper': 'CREATE', 'request-id': 'req-854ab66d-b57e-4e35-8305-1d0f374869a0', 'type': 'virtual_machine_interface', 'uuid': 'e02048c4-86d3-11f0-93e1-fa163e599e0d'} 09/01/2025 01:35:00.622 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2025-09-01T01:35:00.591651', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.591651', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13765896304333387515, 'uuid_mslong': 12941592107138171089}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b399c574-35f8-40d1-bf0a-49c102a776fb', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-6f69ecda-97a5-4292-87aa-f9505f715fd1', 'type': 'alarm', 'uuid': 'b399c574-35f8-40d1-bf0a-49c102a776fb'} 09/01/2025 01:35:00.632 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'coredns-6f867cd986-wlkqx__e02048c4-86d3-11f0-93e1-fa163e599e0d'], 'oper': 'UPDATE', 'request-id': 'req-854ab66d-b57e-4e35-8305-1d0f374869a0', 'type': 'virtual_machine_interface', 'uuid': 'e02048c4-86d3-11f0-93e1-fa163e599e0d'} 09/01/2025 01:35:00.661 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:00.680 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'coredns-6f867cd986-wlkqx__e02048c4-86d3-11f0-93e1-fa163e599e0d'], 'oper': 'UPDATE', 'request-id': 'req-341bddab-ceb6-434c-b328-52a1c8c3f011', 'type': 'virtual_machine_interface', 'uuid': 'e02048c4-86d3-11f0-93e1-fa163e599e0d'} 09/01/2025 01:35:00.687 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2025-09-01T01:35:00.676695', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.676695', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12737114632070279124, 'uuid_mslong': 3323528339732513001}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2e1f8b6a-8ab3-40e9-b0c3-524613faafd4', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-403323e3-fe22-4014-99d0-048dab956108', 'type': 'alarm', 'uuid': '2e1f8b6a-8ab3-40e9-b0c3-524613faafd4'} 09/01/2025 01:35:00.743 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2025-09-01T01:35:00.737556', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.737556', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10437081795927609670, 'uuid_mslong': 1742884343849304489}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '182ff813-97ba-41a9-90d7-f69869f61146', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-ce389d40-228e-4de7-877a-338c3d9f547c', 'type': 'alarm', 'uuid': '182ff813-97ba-41a9-90d7-f69869f61146'} 09/01/2025 01:35:00.778 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2025-09-01T01:35:00.770077', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.770077', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10283240903023742618, 'uuid_mslong': 17457322688003264184}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f244de7d-ebcd-4eb8-8eb5-691e4c7f4e9a', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-a4f088e2-148a-4e77-8192-29645683a9a4', 'type': 'alarm', 'uuid': 'f244de7d-ebcd-4eb8-8eb5-691e4c7f4e9a'} 09/01/2025 01:35:00.843 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['coredns-6f867cd986-wlkqx__e03cee52-86d3-11f0-93e1-fa163e599e0d'], 'obj_dict': {'display_name': 'coredns-6f867cd986-wlkqx__e03cee52-86d3-11f0-93e1-fa163e599e0d', 'fq_name': ['coredns-6f867cd986-wlkqx__e03cee52-86d3-11f0-93e1-fa163e599e0d'], 'id_perms': {'created': '2025-09-01T01:35:00.818422', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:00.818422', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10656073166777589261, 'uuid_mslong': 16158051601315205616}}, 'instance_ip_address': '10.47.255.252', 'perms2': {'global_access': 0, 'owner': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'owner_access': 7, 'share': []}, 'subnet_uuid': 'eada5f2d-448e-4621-9fea-812925eb46e9', 'uuid': 'e03cee52-86d3-11f0-93e1-fa163e599e0d', 'virtual_machine_interface_refs': [{'to': ['default-domain', 'k8s-kube-system', 'coredns-6f867cd986-wlkqx__e02048c4-86d3-11f0-93e1-fa163e599e0d'], 'uuid': 'e02048c4-86d3-11f0-93e1-fa163e599e0d'}], 'virtual_network_refs': [{'to': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'}]}, 'oper': 'CREATE', 'request-id': 'req-c80d919e-d72c-4d2d-b5cf-ce84e19a49b9', 'type': 'instance_ip', 'uuid': 'e03cee52-86d3-11f0-93e1-fa163e599e0d'} 09/01/2025 01:35:00.869 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2025-09-01T01:35:00.861644', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.861644', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12788391283575139026, 'uuid_mslong': 5764728618455484405}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '50006e22-b991-47f5-b179-7e1dda32aad2', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-5e38e384-5e93-4efc-b6a4-b22ad6729fbf', 'type': 'alarm', 'uuid': '50006e22-b991-47f5-b179-7e1dda32aad2'} 09/01/2025 01:35:00.884 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['coredns-6f867cd986-wlkqx__e03cee52-86d3-11f0-93e1-fa163e599e0d'], 'oper': 'UPDATE', 'request-id': 'req-cad95a26-b166-494b-93d6-2b3f5d2e7f85', 'type': 'instance_ip', 'uuid': 'e03cee52-86d3-11f0-93e1-fa163e599e0d'} 09/01/2025 01:35:00.902 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2025-09-01T01:35:00.897537', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.897537', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9800546595679803193, 'uuid_mslong': 16768712725561229374}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e8b66f61-23a6-403e-8802-893408289739', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-68e47281-94a2-4cf6-9860-a1a9cffe35b4', 'type': 'alarm', 'uuid': 'e8b66f61-23a6-403e-8802-893408289739'} 09/01/2025 01:35:00.923 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2025-09-01T01:35:00.919411', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.919411', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9841848269247336815, 'uuid_mslong': 13773325918658710460}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bf24aef2-e555-4bbc-8895-44db45c7d16f', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-468f6b69-7fe0-47a7-881d-24e979235447', 'type': 'alarm', 'uuid': 'bf24aef2-e555-4bbc-8895-44db45c7d16f'} 09/01/2025 01:35:00.965 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'coredns-6f867cd986-wlkqx__e02048c4-86d3-11f0-93e1-fa163e599e0d'], 'oper': 'UPDATE', 'request-id': 'req-5cb9c65d-a555-4752-be33-f345bd871e71', 'type': 'virtual_machine_interface', 'uuid': 'e02048c4-86d3-11f0-93e1-fa163e599e0d'} 09/01/2025 01:35:01.000 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2025-09-01T01:35:00.993525', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2025-09-01T01:35:00.993525', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13655082713157644973, 'uuid_mslong': 7422783952441593023}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '670306ad-59c0-4cbf-bd80-99614056b2ad', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-553602d1-d201-4b11-8569-96d2a7801aee', 'type': 'alarm', 'uuid': '670306ad-59c0-4cbf-bd80-99614056b2ad'} 09/01/2025 01:35:01.029 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2025-09-01T01:35:01.022450', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2025-09-01T01:35:01.022450', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10351739637149028015, 'uuid_mslong': 894098479270019581}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0c6879d4-6b1b-41fd-8fa8-c45aa7994eaf', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-d87fd2d0-ee20-4f9c-aa86-fa97c52766aa', 'type': 'alarm', 'uuid': '0c6879d4-6b1b-41fd-8fa8-c45aa7994eaf'} 09/01/2025 01:35:01.068 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2025-09-01T01:35:01.060992', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2025-09-01T01:35:01.060992', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10335860996523724715, 'uuid_mslong': 16042134643040011702}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dea11c76-8563-45b6-8f70-5ad0899c8fab', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-a70d16ac-9e75-4a7b-abc2-b8ad36bbe09e', 'type': 'alarm', 'uuid': 'dea11c76-8563-45b6-8f70-5ad0899c8fab'} 09/01/2025 01:35:01.090 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kubernetes.io__slash__metadata.name'], 'obj_dict': {'display_name': 'kubernetes.io__slash__metadata.name', 'fq_name': ['kubernetes.io__slash__metadata.name'], 'id_perms': {'created': '2025-09-01T01:35:01.087385', 'creator': None, 'description': None, 'enable': None, 'last_modified': '2025-09-01T01:35:01.087385', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 13828626881080767734, 'uuid_mslong': 14178771421114287520}}, 'name': 'kubernetes.io__slash__metadata.name', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0102', 'uuid': 'c4c51d7c-32fa-45a0-bfe9-26e1923cb4f6'}, 'oper': 'CREATE', 'request-id': 'req-e4e030dc-7426-4998-a3af-f25f1827bff9', 'type': 'tag_type', 'uuid': 'c4c51d7c-32fa-45a0-bfe9-26e1923cb4f6'} 09/01/2025 01:35:01.096 7fb2d4601900 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:35:01.119 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kubernetes.io__slash__metadata.name=contrail'], 'obj_dict': {'display_name': 'kubernetes.io__slash__metadata.name=contrail', 'fq_name': ['kubernetes.io__slash__metadata.name=contrail'], 'id_perms': {'created': '2025-09-01T01:35:01.111225', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:01.111225', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12675199517905652019, 'uuid_mslong': 11957672635128762339}}, 'name': 'kubernetes.io__slash__metadata.name=contrail', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01020000', 'tag_type_name': 'kubernetes.io__slash__metadata.name', 'tag_type_refs': [{'to': ['kubernetes.io__slash__metadata.name'], 'uuid': 'c4c51d7c-32fa-45a0-bfe9-26e1923cb4f6'}], 'tag_value': 'contrail', 'uuid': 'a5f22fe8-3d42-4fe3-afe7-5ace31f80933'}, 'oper': 'CREATE', 'request-id': 'req-e4e030dc-7426-4998-a3af-f25f1827bff9', 'type': 'tag', 'uuid': 'a5f22fe8-3d42-4fe3-afe7-5ace31f80933'} 09/01/2025 01:35:01.185 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2025-09-01T01:35:01.130566', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2025-09-01T01:35:01.130566', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10504271381337467867, 'uuid_mslong': 3142675033853412581}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2b9d064a-ed52-44e5-91c6-ab2ad4ebebdb', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-253fdcfe-1152-4fe9-8a2b-7295bef192e3', 'type': 'alarm', 'uuid': '2b9d064a-ed52-44e5-91c6-ab2ad4ebebdb'} 09/01/2025 01:35:01.227 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2025-09-01T01:35:01.217585', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2025-09-01T01:35:01.217585', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12284578432857240966, 'uuid_mslong': 2852633633655180775}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2796972d-0859-4de7-aa7b-96ff89e17586', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-aa6e16b3-5471-478a-9bfe-77fcf366581b', 'type': 'alarm', 'uuid': '2796972d-0859-4de7-aa7b-96ff89e17586'} 09/01/2025 01:35:01.392 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2025-09-01T01:35:01.386361', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2025-09-01T01:35:01.386361', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12208880729113631627, 'uuid_mslong': 17929068975300495646}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f8d0d93d-a243-491e-a96e-a85673ee1b8b', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-9fc5f925-daa3-46cb-b392-b79e0fde1670', 'type': 'alarm', 'uuid': 'f8d0d93d-a243-491e-a96e-a85673ee1b8b'} 09/01/2025 01:35:01.594 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['namespace=contrail'], 'obj_dict': {'display_name': 'namespace=contrail', 'fq_name': ['namespace=contrail'], 'id_perms': {'created': '2025-09-01T01:35:01.557786', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:01.557786', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9297889043599944578, 'uuid_mslong': 764438863256043651}}, 'name': 'namespace=contrail', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01010001', 'tag_type_name': 'namespace', 'tag_type_refs': [{'to': ['namespace'], 'uuid': '884e5052-64fc-44a5-a883-82d91352fa8e'}], 'tag_value': 'contrail', 'uuid': '0a9bd518-90e1-4083-8108-bcd2a4c56b82'}, 'oper': 'CREATE', 'request-id': 'req-386a6bfc-4958-462d-9f83-0968d86a25f4', 'type': 'tag', 'uuid': '0a9bd518-90e1-4083-8108-bcd2a4c56b82'} 09/01/2025 01:35:01.660 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2025-09-01T01:35:01.645266', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2025-09-01T01:35:01.645266', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12068159765698629765, 'uuid_mslong': 7356697359278424505}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '66183d45-53d8-41b9-a77a-b75df720d085', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-92fc4d7a-14e9-4658-a1ae-6a28b3678823', 'type': 'alarm', 'uuid': '66183d45-53d8-41b9-a77a-b75df720d085'} 09/01/2025 01:35:01.665 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:01.705 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2025-09-01T01:35:01.691703', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2025-09-01T01:35:01.691703', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12165997184363612657, 'uuid_mslong': 4383944909124291530}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3cd6e6aa-ef3c-4bca-a8d6-4dfb206549f1', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-b024a142-709f-492d-9da3-c5bfe05e542d', 'type': 'alarm', 'uuid': '3cd6e6aa-ef3c-4bca-a8d6-4dfb206549f1'} 09/01/2025 01:35:01.728 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail'], 'obj_dict': {'display_name': 'k8s-contrail', 'fq_name': ['default-domain', 'k8s-contrail'], 'id_perms': {'created': '2025-09-01T01:35:01.717377', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:01.717377', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10022379383818498906, 'uuid_mslong': 581816361761063834}}, 'parent_type': 'domain', 'parent_uuid': 'ce056a4b-12ea-41a5-896d-393d506f2011', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '081306e5-ff47-439a-8b16-a4f2e0b3335a'}, 'oper': 'CREATE', 'request-id': 'req-f6923dc9-5523-457c-b447-e80fcbd284bc', 'type': 'project', 'uuid': '081306e5-ff47-439a-8b16-a4f2e0b3335a'} 09/01/2025 01:35:01.770 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2025-09-01T01:35:01.757037', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2025-09-01T01:35:01.757037', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11501329277269896852, 'uuid_mslong': 7179776699111329448}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '63a3b0de-2528-4ea8-9f9c-ee0a8078ee94', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-a623d8e3-f755-46c3-a9fa-86f1648b62b1', 'type': 'alarm', 'uuid': '63a3b0de-2528-4ea8-9f9c-ee0a8078ee94'} 09/01/2025 01:35:01.800 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'display_name': 'default-application-policy-set', 'fq_name': ['default-domain', 'k8s-contrail', 'default-application-policy-set'], 'id_perms': {'created': '2025-09-01T01:35:01.791455', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:01.791455', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11424969983852188087, 'uuid_mslong': 3187153430437121841}}, 'parent_type': 'project', 'parent_uuid': '081306e5-ff47-439a-8b16-a4f2e0b3335a', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '2c3b0b28-a1df-4f31-9e8d-a5ab110291b7'}, 'oper': 'CREATE', 'request-id': 'req-f6923dc9-5523-457c-b447-e80fcbd284bc', 'type': 'application_policy_set', 'uuid': '2c3b0b28-a1df-4f31-9e8d-a5ab110291b7'} 09/01/2025 01:35:01.841 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail'], 'oper': 'UPDATE', 'request-id': 'req-f6923dc9-5523-457c-b447-e80fcbd284bc', 'type': 'project', 'uuid': '081306e5-ff47-439a-8b16-a4f2e0b3335a'} 09/01/2025 01:35:01.887 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2025-09-01T01:35:01.847333', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2025-09-01T01:35:01.847333', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12785828124223818586, 'uuid_mslong': 1599492486595233073}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '163289f1-2c6a-4531-b170-62efcf8f4b5a', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-45d7d2da-c7ae-4f84-9f98-ca6666f35674', 'type': 'alarm', 'uuid': '163289f1-2c6a-4531-b170-62efcf8f4b5a'} 09/01/2025 01:35:01.933 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2025-09-01T01:35:01.919901', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2025-09-01T01:35:01.919901', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9569444448425120023, 'uuid_mslong': 17242802562263173967}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ef4abd92-f7e4-4b4f-84cd-7f0656369117', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-3cdce8d0-2fa6-434f-9793-383dff488d4f', 'type': 'alarm', 'uuid': 'ef4abd92-f7e4-4b4f-84cd-7f0656369117'} 09/01/2025 01:35:01.947 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail', 'default'], 'obj_dict': {'display_name': 'default', 'fq_name': ['default-domain', 'k8s-contrail', 'default'], 'id_perms': {'created': '2025-09-01T01:35:01.920792', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:35:01.920792', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12418792943944759266, 'uuid_mslong': 12529932026945814864}}, 'parent_type': 'project', 'parent_uuid': '081306e5-ff47-439a-8b16-a4f2e0b3335a', 'perms2': {'global_access': 0, 'owner': '081306e5-ff47-439a-8b16-a4f2e0b3335a', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'd804800b-1a50-43a7-bbf4-00825bf2493d', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-contrail:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'bbd99afb-2454-4294-8e57-8389a1db15a8', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-contrail:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'faa114d9-5d7d-4d3e-887b-950566a31e78', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '8c6e98be-4225-4ef3-bec9-0b5e2d468aa6', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000006, 'uuid': 'ade342ca-c5e5-4150-ac58-6a628af477e2'}, 'oper': 'CREATE', 'request-id': 'req-e8beff0e-d485-41cb-9653-01f21116aaf1', 'type': 'security_group', 'uuid': 'ade342ca-c5e5-4150-ac58-6a628af477e2'} 09/01/2025 01:35:01.995 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2025-09-01T01:35:01.982979', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2025-09-01T01:35:01.982979', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11703449765111169089, 'uuid_mslong': 12023298412754059803}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a6db5634-48b9-421b-a26b-018dc8148041', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-bda61db9-3971-4fce-ada9-03bd9e2b9951', 'type': 'alarm', 'uuid': 'a6db5634-48b9-421b-a26b-018dc8148041'} 09/01/2025 01:35:02.017 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail', 'default', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000006', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'd804800b-1a50-43a7-bbf4-00825bf2493d'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000006', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'bbd99afb-2454-4294-8e57-8389a1db15a8'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-contrail', 'default', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:02.004892', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:02.004892', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9548772609716880718, 'uuid_mslong': 14927954596232578009}}, 'parent_type': 'security-group', 'parent_uuid': 'ade342ca-c5e5-4150-ac58-6a628af477e2', 'perms2': {'global_access': 0, 'owner': '081306e5-ff47-439a-8b16-a4f2e0b3335a', 'owner_access': 7, 'share': []}, 'uuid': 'cf2abf9d-139a-43d9-8484-0e18d327854e'}, 'oper': 'CREATE', 'request-id': 'req-3bfe52a8-b579-41fa-9985-6b1ed0de9582', 'type': 'access_control_list', 'uuid': 'cf2abf9d-139a-43d9-8484-0e18d327854e'} 09/01/2025 01:35:02.023 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail'], 'oper': 'UPDATE', 'request-id': 'req-5414dd4a-0dbb-4323-bd25-63dcd92fad2d', 'type': 'project', 'uuid': '081306e5-ff47-439a-8b16-a4f2e0b3335a'} 09/01/2025 01:35:02.090 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2025-09-01T01:35:02.077045', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2025-09-01T01:35:02.077045', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13572308632227373667, 'uuid_mslong': 6614552712968424813}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5bcb9ca5-a494-4d6d-bc5a-86cab5e16263', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-5350116d-a370-45ea-a441-44398ce65320', 'type': 'alarm', 'uuid': '5bcb9ca5-a494-4d6d-bc5a-86cab5e16263'} 09/01/2025 01:35:02.158 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail', 'default', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'faa114d9-5d7d-4d3e-887b-950566a31e78'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '8c6e98be-4225-4ef3-bec9-0b5e2d468aa6'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-contrail', 'default', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:02.094615', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:02.094615', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12448090761444631064, 'uuid_mslong': 3778302967327313713}}, 'parent_type': 'security-group', 'parent_uuid': 'ade342ca-c5e5-4150-ac58-6a628af477e2', 'perms2': {'global_access': 0, 'owner': '081306e5-ff47-439a-8b16-a4f2e0b3335a', 'owner_access': 7, 'share': []}, 'uuid': '346f3a87-cd59-4f31-acc0-80983fbaa218'}, 'oper': 'CREATE', 'request-id': 'req-9ee39db1-9e38-4b0d-846b-682b1482786b', 'type': 'access_control_list', 'uuid': '346f3a87-cd59-4f31-acc0-80983fbaa218'} 09/01/2025 01:35:02.257 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2025-09-01T01:35:02.218693', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2025-09-01T01:35:02.218693', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10910313226223040477, 'uuid_mslong': 10914525326012924032}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '97782ef4-d501-4080-9769-3812ed4537dd', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-41017a40-8c14-4dbc-adcf-aed02fca1acb', 'type': 'alarm', 'uuid': '97782ef4-d501-4080-9769-3812ed4537dd'} 09/01/2025 01:35:02.258 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-8c7c3952-7c75-4929-816b-276916e02baa', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:35:02.349 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-8c7c3952-7c75-4929-816b-276916e02baa', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:35:02.372 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-e158efc6-5d82-4115-87ed-1b5df6f86915', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:35:02.400 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-e158efc6-5d82-4115-87ed-1b5df6f86915', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:35:02.497 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail', 'k8s-contrail-default-sg'], 'obj_dict': {'display_name': 'k8s-contrail-default-sg', 'fq_name': ['default-domain', 'k8s-contrail', 'k8s-contrail-default-sg'], 'id_perms': {'created': '2025-09-01T01:35:02.440898', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:35:02.440898', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10716835512065823629, 'uuid_mslong': 11418210244986487825}}, 'parent_type': 'project', 'parent_uuid': '081306e5-ff47-439a-8b16-a4f2e0b3335a', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '21fdef34-3bf5-42fa-96b1-22b0c5228755', 'src_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '31e479d7-1eaf-4aba-9e13-86ad6cd34c10', 'src_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '232937ba-3215-42cc-bea1-15bb5eeff8dd', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'cf245d60-d348-471f-b7e4-a265c7e2fc87', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000007, 'uuid': '9e75a1b8-b725-4411-94b9-d91e34f9938d'}, 'oper': 'CREATE', 'request-id': 'req-17a260cb-66df-4abe-aa94-0a775f7ca667', 'type': 'security_group', 'uuid': '9e75a1b8-b725-4411-94b9-d91e34f9938d'} 09/01/2025 01:35:02.551 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-f1e0bc91-b510-4c29-8f03-74b1320fe568', 'type': 'global_vrouter_config', 'uuid': '87a687b0-9781-4994-aa87-dbc3f38997c0'} 09/01/2025 01:35:02.561 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_security_group_id': None}, 'fq_name': ['default-domain', 'k8s-contrail', 'k8s-contrail-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-e7a802d7-8225-44cc-92df-e864f964ac58', 'type': 'security_group', 'uuid': '9e75a1b8-b725-4411-94b9-d91e34f9938d'} 09/01/2025 01:35:02.592 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail', 'k8s-contrail-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-3b559cce-98b5-4e6c-90a0-f1224781a986', 'type': 'security_group', 'uuid': '9e75a1b8-b725-4411-94b9-d91e34f9938d'} 09/01/2025 01:35:02.609 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail', 'k8s-contrail-default-sg', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '21fdef34-3bf5-42fa-96b1-22b0c5228755'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '31e479d7-1eaf-4aba-9e13-86ad6cd34c10'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-contrail', 'k8s-contrail-default-sg', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:02.576967', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:02.576967', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13403080425643194522, 'uuid_mslong': 5016664225494878536}}, 'parent_type': 'security-group', 'parent_uuid': '9e75a1b8-b725-4411-94b9-d91e34f9938d', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '459ec588-9e08-4948-ba01-4ea27274389a'}, 'oper': 'CREATE', 'request-id': 'req-efffa46b-2a53-4867-a5f2-a2c1d4c53658', 'type': 'access_control_list', 'uuid': '459ec588-9e08-4948-ba01-4ea27274389a'} 09/01/2025 01:35:02.666 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:02.717 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-contrail', 'k8s-contrail-default-sg', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '232937ba-3215-42cc-bea1-15bb5eeff8dd'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'cf245d60-d348-471f-b7e4-a265c7e2fc87'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-contrail', 'k8s-contrail-default-sg', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:02.652534', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:02.652534', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12395505328244393664, 'uuid_mslong': 16623783802522192305}}, 'parent_type': 'security-group', 'parent_uuid': '9e75a1b8-b725-4411-94b9-d91e34f9938d', 'perms2': {'global_access': 0, 'owner': '081306e5-ff47-439a-8b16-a4f2e0b3335a', 'owner_access': 7, 'share': []}, 'uuid': 'e6b38b4a-b43a-49b1-ac05-ae6bfd7806c0'}, 'oper': 'CREATE', 'request-id': 'req-86814ae2-c3de-44e8-a9c3-8d60164d274e', 'type': 'access_control_list', 'uuid': 'e6b38b4a-b43a-49b1-ac05-ae6bfd7806c0'} 09/01/2025 01:35:02.801 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-contrail-ingress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-contrail-ingress', 'endpoint_1': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842753], 'tags': ['namespace=contrail'], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-contrail-ingress'], 'id_perms': {'created': '2025-09-01T01:35:02.748868', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:02.748868', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10183644137596290291, 'uuid_mslong': 5575263468403573073}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=contrail'], 'uuid': '0a9bd518-90e1-4083-8108-bcd2a4c56b82'}], 'uuid': '4d5f5095-e368-4151-8d53-92634c6a84f3'}, 'oper': 'CREATE', 'request-id': 'req-7562bb48-db8d-4a88-81bf-f41930c935bd', 'type': 'firewall_rule', 'uuid': '4d5f5095-e368-4151-8d53-92634c6a84f3'} 09/01/2025 01:35:02.931 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-2b864465-9bda-450c-9ea5-037acee3ce31', 'type': 'global_vrouter_config', 'uuid': '87a687b0-9781-4994-aa87-dbc3f38997c0'} 09/01/2025 01:35:02.944 7fb2d4601b80 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:02.945 7fb2d4601b80 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:02.945 7fb2d4601b80 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:02.945 7fb2d4601b80 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:02.946 7fb2d4601b80 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:02.962 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-36286e64-75c0-4420-bcc6-90f5138fbab0', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:03.189 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-contrail-egress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-contrail-egress', 'endpoint_1': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842753], 'tags': ['namespace=contrail'], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-contrail-egress'], 'id_perms': {'created': '2025-09-01T01:35:03.125206', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:03.125206', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11604150138806812443, 'uuid_mslong': 12778824617337704182}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=contrail'], 'uuid': '0a9bd518-90e1-4083-8108-bcd2a4c56b82'}], 'uuid': 'b1578148-cb6e-4ef6-a10a-3911dfe13f1b'}, 'oper': 'CREATE', 'request-id': 'req-32c4d195-9bb9-4cef-b82d-7a4b8a39c7af', 'type': 'firewall_rule', 'uuid': 'b1578148-cb6e-4ef6-a10a-3911dfe13f1b'} 09/01/2025 01:35:03.251 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-57cf9ce7-8537-4ed5-a884-fe86d3d00ede', 'type': 'global_system_config', 'uuid': '70eaa5ad-608f-40c9-a193-2be391842efd'} 09/01/2025 01:35:03.319 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-e5632fa9-9725-4744-86b1-f4682e824cfc', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:03.395 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['k8s-svc'], 'obj_dict': {'display_name': 'k8s-svc', 'fq_name': ['k8s-svc'], 'id_perms': {'created': '2025-09-01T01:35:03.390359', 'creator': None, 'description': None, 'enable': None, 'last_modified': '2025-09-01T01:35:03.390359', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 11543464585065071630, 'uuid_mslong': 15268846470947556803}}, 'name': 'k8s-svc', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0103', 'uuid': 'd3e5d6f7-aece-4dc3-a032-9fe1561b040e'}, 'oper': 'CREATE', 'request-id': 'req-43818550-ab00-4cb8-8c28-dd5a32a8bb02', 'type': 'tag_type', 'uuid': 'd3e5d6f7-aece-4dc3-a032-9fe1561b040e'} 09/01/2025 01:35:03.431 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['k8s-svc=kubernetes'], 'obj_dict': {'display_name': 'k8s-svc=kubernetes', 'fq_name': ['k8s-svc=kubernetes'], 'id_perms': {'created': '2025-09-01T01:35:03.423866', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:03.423866', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9232761476190750890, 'uuid_mslong': 7821842526510074911}}, 'name': 'k8s-svc=kubernetes', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01030000', 'tag_type_name': 'k8s-svc', 'tag_type_refs': [{'to': ['k8s-svc'], 'uuid': 'd3e5d6f7-aece-4dc3-a032-9fe1561b040e'}], 'tag_value': 'kubernetes', 'uuid': '6c8cc456-01ad-4c1f-8021-5ba53442c8aa'}, 'oper': 'CREATE', 'request-id': 'req-43818550-ab00-4cb8-8c28-dd5a32a8bb02', 'type': 'tag', 'uuid': '6c8cc456-01ad-4c1f-8021-5ba53442c8aa'} 09/01/2025 01:35:03.525 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default'], 'oper': 'UPDATE', 'request-id': 'req-e519e413-4c52-4bd9-bb51-6e15fb5ebf86', 'type': 'project', 'uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8'} 09/01/2025 01:35:03.667 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:03.768 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s__Service__kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1'], 'obj_dict': {'display_name': 'default__kubernetes', 'fq_name': ['default-domain', 'k8s-default', 'k8s__Service__kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1'], 'id_perms': {'created': '2025-09-01T01:35:03.714936', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:03.714936', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10490939060604764201, 'uuid_mslong': 697245358317782078}}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'security_group_refs': [{'to': ['default-domain', 'k8s-default', 'k8s-default-default-sg']}], 'uuid': '09ad1cf5-8fd2-443e-9197-4d7e039e0029', 'virtual_machine_interface_device_owner': 'K8S:LOADBALANCER', 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:09:ad:1c:f5:8f']}, 'virtual_network_refs': [{'to': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'}]}, 'oper': 'CREATE', 'request-id': 'req-ebf64703-2423-41fb-8784-1254e6b22ab9', 'type': 'virtual_machine_interface', 'uuid': '09ad1cf5-8fd2-443e-9197-4d7e039e0029'} 09/01/2025 01:35:03.792 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s__Service__kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1'], 'oper': 'UPDATE', 'request-id': 'req-ebf64703-2423-41fb-8784-1254e6b22ab9', 'type': 'virtual_machine_interface', 'uuid': '09ad1cf5-8fd2-443e-9197-4d7e039e0029'} 09/01/2025 01:35:03.903 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kubernetes__7a7d590e-3340-4e88-a363-525aacd0cc23'], 'obj_dict': {'display_name': 'kubernetes', 'fq_name': ['kubernetes__7a7d590e-3340-4e88-a363-525aacd0cc23'], 'id_perms': {'created': '2025-09-01T01:35:03.879882', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:03.879882', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11773344400276507683, 'uuid_mslong': 8826308762240306824}}, 'instance_ip_address': '10.96.0.1', 'perms2': {'global_access': 0, 'owner': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'owner_access': 7, 'share': []}, 'subnet_uuid': 'cdf5a7bb-3fee-45f9-9299-6a9e2ef0e400', 'uuid': '7a7d590e-3340-4e88-a363-525aacd0cc23', 'virtual_machine_interface_refs': [{'to': ['default-domain', 'k8s-default', 'k8s__Service__kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1'], 'uuid': '09ad1cf5-8fd2-443e-9197-4d7e039e0029'}], 'virtual_network_refs': [{'to': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'}]}, 'oper': 'CREATE', 'request-id': 'req-1d81df02-2873-48de-a3e5-27ed63c314a4', 'type': 'instance_ip', 'uuid': '7a7d590e-3340-4e88-a363-525aacd0cc23'} 09/01/2025 01:35:04.003 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1'], 'obj_dict': {'display_name': 'default__kubernetes', 'fq_name': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1'], 'id_perms': {'created': '2025-09-01T01:35:03.939097', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:03.939097', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10428285300873467569, 'uuid_mslong': 4704541594682671217}}, 'loadbalancer_properties': {'admin_state': True, 'operating_status': 'ONLINE', 'provisioning_status': 'ACTIVE', 'status': None, 'vip_address': '10.96.0.1', 'vip_subnet_id': None}, 'loadbalancer_provider': 'native', 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'service_appliance_set_refs': [{'to': ['default-global-system-config', 'native'], 'uuid': 'ce9684c7-029d-4e16-ad7f-6b14554d8775'}], 'uuid': '4149e3a7-961c-4071-90b8-b63acefd96b1', 'virtual_machine_interface_refs': [{'to': ['default-domain', 'k8s-default', 'k8s__Service__kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1'], 'uuid': '09ad1cf5-8fd2-443e-9197-4d7e039e0029'}]}, 'oper': 'CREATE', 'request-id': 'req-0be6ff65-919f-4513-9db1-ad436c8d62fb', 'type': 'loadbalancer', 'uuid': '4149e3a7-961c-4071-90b8-b63acefd96b1'} 09/01/2025 01:35:04.061 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1'], 'oper': 'UPDATE', 'request-id': 'req-3ba112e4-6a8f-4de0-b8d7-a0443d433b47', 'type': 'loadbalancer', 'uuid': '4149e3a7-961c-4071-90b8-b63acefd96b1'} 09/01/2025 01:35:04.089 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default'], 'oper': 'UPDATE', 'request-id': 'req-c4362afb-39c1-4736-8e15-c1eb7f6b633f', 'type': 'project', 'uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8'} 09/01/2025 01:35:04.144 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default'], 'oper': 'UPDATE', 'request-id': 'req-c077d094-eca3-4f1c-aa1d-8f898a4dd81c', 'type': 'project', 'uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8'} 09/01/2025 01:35:04.207 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kubernetes__7a7d590e-3340-4e88-a363-525aacd0cc23', '6e324ad2-40d0-4016-9315-3daed4aa8660'], 'obj_dict': {'display_name': '6e324ad2-40d0-4016-9315-3daed4aa8660', 'floating_ip_address': '10.96.0.1', 'floating_ip_traffic_direction': 'ingress', 'fq_name': ['kubernetes__7a7d590e-3340-4e88-a363-525aacd0cc23', '6e324ad2-40d0-4016-9315-3daed4aa8660'], 'id_perms': {'created': '2025-09-01T01:35:04.197352', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:04.197352', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10598445119187879520, 'uuid_mslong': 7940491359898583062}}, 'parent_type': 'instance-ip', 'parent_uuid': '7a7d590e-3340-4e88-a363-525aacd0cc23', 'perms2': {'global_access': 0, 'owner': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'owner_access': 7, 'share': []}, 'project_refs': [{'to': ['default-domain', 'k8s-default'], 'uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8'}], 'uuid': '6e324ad2-40d0-4016-9315-3daed4aa8660'}, 'oper': 'CREATE', 'request-id': 'req-6ed18d80-3769-462c-a82c-86b3504280a7', 'type': 'floating_ip', 'uuid': '6e324ad2-40d0-4016-9315-3daed4aa8660'} 09/01/2025 01:35:04.217 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1-TCP-443-11d02361-e609-4206-93f6-a60460b35529'], 'obj_dict': {'display_name': 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1-TCP-443-11d02361-e609-4206-93f6-a60460b35529', 'fq_name': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1-TCP-443-11d02361-e609-4206-93f6-a60460b35529'], 'id_perms': {'created': '2025-09-01T01:35:04.198842', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:04.198842', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10661891705578673449, 'uuid_mslong': 1283564797178757638}}, 'loadbalancer_listener_properties': {'admin_state': True, 'connection_limit': None, 'default_tls_container': None, 'protocol': 'TCP', 'protocol_port': 443, 'sni_containers': []}, 'loadbalancer_refs': [{'to': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1'], 'uuid': '4149e3a7-961c-4071-90b8-b63acefd96b1'}], 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '11d02361-e609-4206-93f6-a60460b35529'}, 'oper': 'CREATE', 'request-id': 'req-39ff537b-90f1-4945-9ff4-d0ea178df0cc', 'type': 'loadbalancer_listener', 'uuid': '11d02361-e609-4206-93f6-a60460b35529'} 09/01/2025 01:35:04.225 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1-TCP-443-11d02361-e609-4206-93f6-a60460b35529'], 'oper': 'UPDATE', 'request-id': 'req-d62472a7-40d7-4304-961e-f17fc8ce3fb8', 'type': 'loadbalancer_listener', 'uuid': '11d02361-e609-4206-93f6-a60460b35529'} 09/01/2025 01:35:04.286 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default'], 'oper': 'UPDATE', 'request-id': 'req-667400c6-66ca-45e3-a5f8-7645de4c80d1', 'type': 'project', 'uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8'} 09/01/2025 01:35:04.386 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1-TCP-443-11d02361-e609-4206-93f6-a60460b35529'], 'obj_dict': {'display_name': 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1-TCP-443-11d02361-e609-4206-93f6-a60460b35529', 'fq_name': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1-TCP-443-11d02361-e609-4206-93f6-a60460b35529'], 'id_perms': {'created': '2025-09-01T01:35:04.378765', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:04.378765', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11940756889999979924, 'uuid_mslong': 47868323585213139}}, 'loadbalancer_listener_refs': [{'to': ['default-domain', 'k8s-default', 'kubernetes__4149e3a7-961c-4071-90b8-b63acefd96b1-TCP-443-11d02361-e609-4206-93f6-a60460b35529'], 'uuid': '11d02361-e609-4206-93f6-a60460b35529'}], 'loadbalancer_pool_properties': {'admin_state': True, 'loadbalancer_method': None, 'persistence_cookie_name': None, 'protocol': 'TCP', 'session_persistence': None, 'status': None, 'status_description': None, 'subnet_id': None}, 'parent_type': 'project', 'parent_uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '00aa0ffc-974a-42d3-a5b6-172069bf3594'}, 'oper': 'CREATE', 'request-id': 'req-ae91cf19-b028-4cc5-a49d-8a7f13fc7c9e', 'type': 'loadbalancer_pool', 'uuid': '00aa0ffc-974a-42d3-a5b6-172069bf3594'} 09/01/2025 01:35:04.464 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-b9fd73f9-712b-4ccf-b991-429312f9ebdc', 'type': 'global_vrouter_config', 'uuid': '87a687b0-9781-4994-aa87-dbc3f38997c0'} 09/01/2025 01:35:04.506 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kubernetes.io__slash__metadata.name=default'], 'obj_dict': {'display_name': 'kubernetes.io__slash__metadata.name=default', 'fq_name': ['kubernetes.io__slash__metadata.name=default'], 'id_perms': {'created': '2025-09-01T01:35:04.498091', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:04.498091', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13662651753165036361, 'uuid_mslong': 1818953846815737330}}, 'name': 'kubernetes.io__slash__metadata.name=default', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01020001', 'tag_type_name': 'kubernetes.io__slash__metadata.name', 'tag_type_refs': [{'to': ['kubernetes.io__slash__metadata.name'], 'uuid': 'c4c51d7c-32fa-45a0-bfe9-26e1923cb4f6'}], 'tag_value': 'default', 'uuid': '193e38e2-ee48-45f2-bd9b-7d61b5451b49'}, 'oper': 'CREATE', 'request-id': 'req-1eb9ae72-3722-444e-bbec-f19cadc5c2a6', 'type': 'tag', 'uuid': '193e38e2-ee48-45f2-bd9b-7d61b5451b49'} 09/01/2025 01:35:04.603 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['namespace=default'], 'obj_dict': {'display_name': 'namespace=default', 'fq_name': ['namespace=default'], 'id_perms': {'created': '2025-09-01T01:35:04.589424', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:04.589424', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10845566140282948963, 'uuid_mslong': 18086324725812776608}}, 'name': 'namespace=default', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01010002', 'tag_type_name': 'namespace', 'tag_type_refs': [{'to': ['namespace'], 'uuid': '884e5052-64fc-44a5-a883-82d91352fa8e'}], 'tag_value': 'default', 'uuid': 'faff8883-3e6f-4ea0-9683-30f13b91cd63'}, 'oper': 'CREATE', 'request-id': 'req-423e7e90-c62d-4292-a7c5-f57bb4a9127d', 'type': 'tag', 'uuid': 'faff8883-3e6f-4ea0-9683-30f13b91cd63'} 09/01/2025 01:35:04.668 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:04.734 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default'], 'oper': 'UPDATE', 'request-id': 'req-7e6f9af7-71b2-4c01-bfe5-c70b2589413b', 'type': 'project', 'uuid': '9023d5fc-34ad-4e7e-9d9e-872a06007bf8'} 09/01/2025 01:35:04.859 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-96f09b0e-4843-46a4-bcc3-14d7074bee54', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:35:04.899 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-96f09b0e-4843-46a4-bcc3-14d7074bee54', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:35:04.932 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-11dc5953-d3ad-42b5-ba91-597bc14c0006', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:35:04.961 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-11dc5953-d3ad-42b5-ba91-597bc14c0006', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:35:05.097 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-8b5248da-cf34-4c23-99f8-c358e451cdee', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:35:05.118 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-8b5248da-cf34-4c23-99f8-c358e451cdee', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:35:05.225 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-532a29a8-81ca-4ca6-afe9-0d0a1bd27472', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:35:05.236 7fb2d4601b80 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:35:05.248 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-532a29a8-81ca-4ca6-afe9-0d0a1bd27472', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:35:05.423 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-service-np'], 'oper': 'UPDATE', 'request-id': 'req-f4014d9f-0e90-4d56-878d-92b1d34140c3', 'type': 'network_policy', 'uuid': '1f1a62da-5984-46dc-82ee-e07966ea5188'} 09/01/2025 01:35:05.438 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-a969ab3e-d4dd-4022-bdbc-9a1f72472875', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:35:05.459 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-a969ab3e-d4dd-4022-bdbc-9a1f72472875', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:35:05.669 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:05.778 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_security_group_id': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-ea757534-9276-4848-bf9e-208ea86cff25', 'type': 'security_group', 'uuid': '4de733ab-781c-4219-bcab-efd8adb97fdf'} 09/01/2025 01:35:05.795 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-10ea4a51-8f7f-43da-bee8-bb494de9a14b', 'type': 'access_control_list', 'uuid': '0a0f9403-fbe0-4cf4-8dd8-61b6703c9a68'} 09/01/2025 01:35:05.816 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-71caae77-7989-4f26-b852-4d8f72616c2e', 'type': 'access_control_list', 'uuid': 'e9c77d30-5ca4-4541-9585-66a4ccc4f9e1'} 09/01/2025 01:35:05.829 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_security_group_id': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-99a26f15-1cc0-4bef-9a6e-db5b3355427e', 'type': 'security_group', 'uuid': '4de733ab-781c-4219-bcab-efd8adb97fdf'} 09/01/2025 01:35:06.024 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-default-ingress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-default-ingress', 'endpoint_1': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842754], 'tags': ['namespace=default'], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-default-ingress'], 'id_perms': {'created': '2025-09-01T01:35:05.975858', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:05.975858', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13323639037654214571, 'uuid_mslong': 10651579802644989837}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=default'], 'uuid': 'faff8883-3e6f-4ea0-9683-30f13b91cd63'}], 'uuid': '93d20365-6161-478d-b8e7-131cf2e827ab'}, 'oper': 'CREATE', 'request-id': 'req-2fc07c57-fbcd-40c9-a93e-fd2c7c97d1fb', 'type': 'firewall_rule', 'uuid': '93d20365-6161-478d-b8e7-131cf2e827ab'} 09/01/2025 01:35:06.112 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-2a936ac1-be50-4966-854f-efc81508be55', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:06.317 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-default-egress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-default-egress', 'endpoint_1': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842754], 'tags': ['namespace=default'], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-default-egress'], 'id_perms': {'created': '2025-09-01T01:35:06.261460', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:06.261460', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12047502222840008587, 'uuid_mslong': 17769216293693834069}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=default'], 'uuid': 'faff8883-3e6f-4ea0-9683-30f13b91cd63'}], 'uuid': 'f698f012-e2b4-4355-a731-5370f71b8f8b'}, 'oper': 'CREATE', 'request-id': 'req-31f11afa-0ead-4690-9c99-719bee03805c', 'type': 'firewall_rule', 'uuid': 'f698f012-e2b4-4355-a731-5370f71b8f8b'} 09/01/2025 01:35:06.453 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-f7649ee7-e03c-4af4-94d7-7b3cecade25a', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:06.495 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['k8s-svc=kube-dns'], 'obj_dict': {'display_name': 'k8s-svc=kube-dns', 'fq_name': ['k8s-svc=kube-dns'], 'id_perms': {'created': '2025-09-01T01:35:06.479406', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:06.479406', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11013834266846936573, 'uuid_mslong': 13924478071625763768}}, 'name': 'k8s-svc=kube-dns', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01030001', 'tag_type_name': 'k8s-svc', 'tag_type_refs': [{'to': ['k8s-svc'], 'uuid': 'd3e5d6f7-aece-4dc3-a032-9fe1561b040e'}], 'tag_value': 'kube-dns', 'uuid': 'c13daf07-f5f8-4bb8-98d8-ffe9726fbdfd'}, 'oper': 'CREATE', 'request-id': 'req-615b3138-4664-4587-a225-9d3958bd9152', 'type': 'tag', 'uuid': 'c13daf07-f5f8-4bb8-98d8-ffe9726fbdfd'} 09/01/2025 01:35:06.595 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-bd0c6ce6-1fc9-4d54-b986-551ec0ac81d7', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:06.670 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:06.823 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'k8s__Service__kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'obj_dict': {'display_name': 'kube-system__kube-dns', 'fq_name': ['default-domain', 'k8s-kube-system', 'k8s__Service__kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'id_perms': {'created': '2025-09-01T01:35:06.764506', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:06.764506', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10524097296904489957, 'uuid_mslong': 4096956869932238070}}, 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'security_group_refs': [{'to': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg']}], 'uuid': '38db5091-0c68-44f6-920d-1abb83a40be5', 'virtual_machine_interface_device_owner': 'K8S:LOADBALANCER', 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:38:db:50:91:0c']}, 'virtual_network_refs': [{'to': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'}]}, 'oper': 'CREATE', 'request-id': 'req-5af837c2-d2d1-4da8-9099-29707c80c392', 'type': 'virtual_machine_interface', 'uuid': '38db5091-0c68-44f6-920d-1abb83a40be5'} 09/01/2025 01:35:06.853 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'k8s__Service__kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'oper': 'UPDATE', 'request-id': 'req-5af837c2-d2d1-4da8-9099-29707c80c392', 'type': 'virtual_machine_interface', 'uuid': '38db5091-0c68-44f6-920d-1abb83a40be5'} 09/01/2025 01:35:06.947 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kube-dns__62fa6a29-784f-494c-91c4-4ca8a0b13fc2'], 'obj_dict': {'display_name': 'kube-dns', 'fq_name': ['kube-dns__62fa6a29-784f-494c-91c4-4ca8a0b13fc2'], 'id_perms': {'created': '2025-09-01T01:35:06.936398', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:06.936398', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10503604518069026754, 'uuid_mslong': 7132129686239267148}}, 'instance_ip_address': '10.105.226.84', 'perms2': {'global_access': 0, 'owner': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'owner_access': 7, 'share': []}, 'subnet_uuid': 'cdf5a7bb-3fee-45f9-9299-6a9e2ef0e400', 'uuid': '62fa6a29-784f-494c-91c4-4ca8a0b13fc2', 'virtual_machine_interface_refs': [{'to': ['default-domain', 'k8s-kube-system', 'k8s__Service__kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'uuid': '38db5091-0c68-44f6-920d-1abb83a40be5'}], 'virtual_network_refs': [{'to': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'}]}, 'oper': 'CREATE', 'request-id': 'req-f5541a6a-8df6-4267-8dfe-656f78dc6123', 'type': 'instance_ip', 'uuid': '62fa6a29-784f-494c-91c4-4ca8a0b13fc2'} 09/01/2025 01:35:06.952 7fb2d4601ea0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:06.956 7fb2d4601ea0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:06.956 7fb2d4601ea0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:06.956 7fb2d4601ea0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:06.956 7fb2d4601ea0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:06.956 7fb2d4601ea0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:06.959 7fb2d4601ea0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:06.960 7fb2d4601ea0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:06.960 7fb2d4601ea0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:06.960 7fb2d4601ea0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:06.960 7fb2d4601ea0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:06.960 7fb2d4601ea0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:06.960 7fb2d4601ea0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:06.960 7fb2d4601ea0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:07.041 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'obj_dict': {'display_name': 'kube-system__kube-dns', 'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'id_perms': {'created': '2025-09-01T01:35:06.982232', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:06.982232', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10160337832390137988, 'uuid_mslong': 768568628610551033}}, 'loadbalancer_properties': {'admin_state': True, 'operating_status': 'ONLINE', 'provisioning_status': 'ACTIVE', 'status': None, 'vip_address': '10.105.226.84', 'vip_subnet_id': None}, 'loadbalancer_provider': 'native', 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'service_appliance_set_refs': [{'to': ['default-global-system-config', 'native'], 'uuid': 'ce9684c7-029d-4e16-ad7f-6b14554d8775'}], 'uuid': '0aaa8118-7dd7-4cf9-8d00-c56d41939884', 'virtual_machine_interface_refs': [{'to': ['default-domain', 'k8s-kube-system', 'k8s__Service__kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'uuid': '38db5091-0c68-44f6-920d-1abb83a40be5'}]}, 'oper': 'CREATE', 'request-id': 'req-e3172508-51f9-47f1-8974-4188a938672d', 'type': 'loadbalancer', 'uuid': '0aaa8118-7dd7-4cf9-8d00-c56d41939884'} 09/01/2025 01:35:07.065 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-6ed18d80-3769-462c-a82c-86b3504280a7', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:07.099 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'oper': 'UPDATE', 'request-id': 'req-11cd59a6-02d3-4968-a81c-bbf3f6b2bba3', 'type': 'loadbalancer', 'uuid': '0aaa8118-7dd7-4cf9-8d00-c56d41939884'} 09/01/2025 01:35:07.121 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-e5683e35-5c34-4c9a-8220-141ab3216dd0', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:07.144 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kube-dns__62fa6a29-784f-494c-91c4-4ca8a0b13fc2', 'e2e22085-46d7-4e9f-9530-11e688ef29d7'], 'obj_dict': {'display_name': 'e2e22085-46d7-4e9f-9530-11e688ef29d7', 'floating_ip_address': '10.105.226.84', 'floating_ip_traffic_direction': 'ingress', 'fq_name': ['kube-dns__62fa6a29-784f-494c-91c4-4ca8a0b13fc2', 'e2e22085-46d7-4e9f-9530-11e688ef29d7'], 'id_perms': {'created': '2025-09-01T01:35:07.137763', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:07.137763', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10750111992370899415, 'uuid_mslong': 16348665354099576479}}, 'parent_type': 'instance-ip', 'parent_uuid': '62fa6a29-784f-494c-91c4-4ca8a0b13fc2', 'perms2': {'global_access': 0, 'owner': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'owner_access': 7, 'share': []}, 'project_refs': [{'to': ['default-domain', 'k8s-kube-system'], 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'}], 'uuid': 'e2e22085-46d7-4e9f-9530-11e688ef29d7'}, 'oper': 'CREATE', 'request-id': 'req-73079181-47b0-4dec-98fa-025964e5bba1', 'type': 'floating_ip', 'uuid': 'e2e22085-46d7-4e9f-9530-11e688ef29d7'} 09/01/2025 01:35:07.193 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-UDP-53-a8fccf8f-1536-430b-9b8a-f74dd27122df'], 'obj_dict': {'display_name': 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-UDP-53-a8fccf8f-1536-430b-9b8a-f74dd27122df', 'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-UDP-53-a8fccf8f-1536-430b-9b8a-f74dd27122df'], 'id_perms': {'created': '2025-09-01T01:35:07.186572', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:07.186572', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11208042536280072927, 'uuid_mslong': 12176835705946129163}}, 'loadbalancer_listener_properties': {'admin_state': True, 'connection_limit': None, 'default_tls_container': None, 'protocol': 'UDP', 'protocol_port': 53, 'sni_containers': []}, 'loadbalancer_refs': [{'to': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'uuid': '0aaa8118-7dd7-4cf9-8d00-c56d41939884'}], 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'a8fccf8f-1536-430b-9b8a-f74dd27122df'}, 'oper': 'CREATE', 'request-id': 'req-f8ccf411-b268-4e0d-ad61-4749ce522a22', 'type': 'loadbalancer_listener', 'uuid': 'a8fccf8f-1536-430b-9b8a-f74dd27122df'} 09/01/2025 01:35:07.210 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-UDP-53-a8fccf8f-1536-430b-9b8a-f74dd27122df'], 'oper': 'UPDATE', 'request-id': 'req-e040d7a9-7962-4c7e-89e1-24d1f5ba7333', 'type': 'loadbalancer_listener', 'uuid': 'a8fccf8f-1536-430b-9b8a-f74dd27122df'} 09/01/2025 01:35:07.272 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-0fe3f21a-58d0-42f3-967c-fd6c676916a3', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:07.362 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-UDP-53-a8fccf8f-1536-430b-9b8a-f74dd27122df'], 'obj_dict': {'display_name': 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-UDP-53-a8fccf8f-1536-430b-9b8a-f74dd27122df', 'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-UDP-53-a8fccf8f-1536-430b-9b8a-f74dd27122df'], 'id_perms': {'created': '2025-09-01T01:35:07.357069', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:07.357069', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12369833172442127356, 'uuid_mslong': 328866569655238908}}, 'loadbalancer_listener_refs': [{'to': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-UDP-53-a8fccf8f-1536-430b-9b8a-f74dd27122df'], 'uuid': 'a8fccf8f-1536-430b-9b8a-f74dd27122df'}], 'loadbalancer_pool_properties': {'admin_state': True, 'loadbalancer_method': None, 'persistence_cookie_name': None, 'protocol': 'UDP', 'session_persistence': None, 'status': None, 'status_description': None, 'subnet_id': None}, 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '04905e67-16cd-40fc-abaa-79bb6e419bfc'}, 'oper': 'CREATE', 'request-id': 'req-c991a278-f364-4a90-ac3a-364e8750245e', 'type': 'loadbalancer_pool', 'uuid': '04905e67-16cd-40fc-abaa-79bb6e419bfc'} 09/01/2025 01:35:07.392 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-c7c7a965-24fc-40d4-995d-1c21b4ccb98f', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:07.470 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-53-096a7ee3-a48c-4713-949f-f75b8435fbb3'], 'obj_dict': {'display_name': 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-53-096a7ee3-a48c-4713-949f-f75b8435fbb3', 'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-53-096a7ee3-a48c-4713-949f-f75b8435fbb3'], 'id_perms': {'created': '2025-09-01T01:35:07.463282', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:07.463282', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10709550411342543795, 'uuid_mslong': 678494210056013587}}, 'loadbalancer_listener_properties': {'admin_state': True, 'connection_limit': None, 'default_tls_container': None, 'protocol': 'TCP', 'protocol_port': 53, 'sni_containers': []}, 'loadbalancer_refs': [{'to': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'uuid': '0aaa8118-7dd7-4cf9-8d00-c56d41939884'}], 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '096a7ee3-a48c-4713-949f-f75b8435fbb3'}, 'oper': 'CREATE', 'request-id': 'req-689cc893-4473-47ec-b007-f31fa198879b', 'type': 'loadbalancer_listener', 'uuid': '096a7ee3-a48c-4713-949f-f75b8435fbb3'} 09/01/2025 01:35:07.487 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-53-096a7ee3-a48c-4713-949f-f75b8435fbb3'], 'oper': 'UPDATE', 'request-id': 'req-672a2903-2517-4396-bb13-c6d3b693205c', 'type': 'loadbalancer_listener', 'uuid': '096a7ee3-a48c-4713-949f-f75b8435fbb3'} 09/01/2025 01:35:07.552 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-6acf1880-92cd-41ec-82c2-dc00cee45367', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:07.598 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-53-096a7ee3-a48c-4713-949f-f75b8435fbb3'], 'obj_dict': {'display_name': 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-53-096a7ee3-a48c-4713-949f-f75b8435fbb3', 'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-53-096a7ee3-a48c-4713-949f-f75b8435fbb3'], 'id_perms': {'created': '2025-09-01T01:35:07.591632', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:07.591632', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12997013705438630066, 'uuid_mslong': 5282566568977188615}}, 'loadbalancer_listener_refs': [{'to': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-53-096a7ee3-a48c-4713-949f-f75b8435fbb3'], 'uuid': '096a7ee3-a48c-4713-949f-f75b8435fbb3'}], 'loadbalancer_pool_properties': {'admin_state': True, 'loadbalancer_method': None, 'persistence_cookie_name': None, 'protocol': 'TCP', 'session_persistence': None, 'status': None, 'status_description': None, 'subnet_id': None}, 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '494f724e-663d-4707-b45e-ab1a9d8d90b2'}, 'oper': 'CREATE', 'request-id': 'req-665d527a-7f15-4ca7-8d71-91ad818ac7a0', 'type': 'loadbalancer_pool', 'uuid': '494f724e-663d-4707-b45e-ab1a9d8d90b2'} 09/01/2025 01:35:07.664 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-0d33716b-4d2c-4b04-80a7-9505fc4c84b1', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:07.672 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:07.698 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-9153-d29b75ec-b179-4d0b-9e50-01234a890d63'], 'obj_dict': {'display_name': 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-9153-d29b75ec-b179-4d0b-9e50-01234a890d63', 'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-9153-d29b75ec-b179-4d0b-9e50-01234a890d63'], 'id_perms': {'created': '2025-09-01T01:35:07.689058', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:07.689058', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11407619107215445347, 'uuid_mslong': 15175853028805266699}}, 'loadbalancer_listener_properties': {'admin_state': True, 'connection_limit': None, 'default_tls_container': None, 'protocol': 'TCP', 'protocol_port': 9153, 'sni_containers': []}, 'loadbalancer_refs': [{'to': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884'], 'uuid': '0aaa8118-7dd7-4cf9-8d00-c56d41939884'}], 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'd29b75ec-b179-4d0b-9e50-01234a890d63'}, 'oper': 'CREATE', 'request-id': 'req-8b9baf47-a7af-4cb8-beb3-49a05b8164db', 'type': 'loadbalancer_listener', 'uuid': 'd29b75ec-b179-4d0b-9e50-01234a890d63'} 09/01/2025 01:35:07.746 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-9153-d29b75ec-b179-4d0b-9e50-01234a890d63'], 'oper': 'UPDATE', 'request-id': 'req-9f31a74c-b813-4e82-ba2d-4d9c64acf448', 'type': 'loadbalancer_listener', 'uuid': 'd29b75ec-b179-4d0b-9e50-01234a890d63'} 09/01/2025 01:35:07.770 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-e2309acc-fa5d-4797-adc5-34a2c98e1b29', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:07.865 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-9153-d29b75ec-b179-4d0b-9e50-01234a890d63'], 'obj_dict': {'display_name': 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-9153-d29b75ec-b179-4d0b-9e50-01234a890d63', 'fq_name': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-9153-d29b75ec-b179-4d0b-9e50-01234a890d63'], 'id_perms': {'created': '2025-09-01T01:35:07.857798', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:07.857798', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12107355557576793757, 'uuid_mslong': 12602419387071219849}}, 'loadbalancer_listener_refs': [{'to': ['default-domain', 'k8s-kube-system', 'kube-dns__0aaa8118-7dd7-4cf9-8d00-c56d41939884-TCP-9153-d29b75ec-b179-4d0b-9e50-01234a890d63'], 'uuid': 'd29b75ec-b179-4d0b-9e50-01234a890d63'}], 'loadbalancer_pool_properties': {'admin_state': True, 'loadbalancer_method': None, 'persistence_cookie_name': None, 'protocol': 'TCP', 'session_persistence': None, 'status': None, 'status_description': None, 'subnet_id': None}, 'parent_type': 'project', 'parent_uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': 'aee4c9a9-7ce0-4889-a805-f7bb6ab75e9d'}, 'oper': 'CREATE', 'request-id': 'req-43656287-d4ff-46d5-a655-da77ddad12ea', 'type': 'loadbalancer_pool', 'uuid': 'aee4c9a9-7ce0-4889-a805-f7bb6ab75e9d'} 09/01/2025 01:35:07.927 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kubernetes.io__slash__metadata.name=kube-node-lease'], 'obj_dict': {'display_name': 'kubernetes.io__slash__metadata.name=kube-node-lease', 'fq_name': ['kubernetes.io__slash__metadata.name=kube-node-lease'], 'id_perms': {'created': '2025-09-01T01:35:07.921452', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:07.921452', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13374079485892415267, 'uuid_mslong': 15718588142150699747}}, 'name': 'kubernetes.io__slash__metadata.name=kube-node-lease', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01020002', 'tag_type_name': 'kubernetes.io__slash__metadata.name', 'tag_type_refs': [{'to': ['kubernetes.io__slash__metadata.name'], 'uuid': 'c4c51d7c-32fa-45a0-bfe9-26e1923cb4f6'}], 'tag_value': 'kube-node-lease', 'uuid': 'da23a4a2-778f-4ae3-b99a-466efa74cf23'}, 'oper': 'CREATE', 'request-id': 'req-96744b7d-1c4d-455b-a918-7b19300b1a83', 'type': 'tag', 'uuid': 'da23a4a2-778f-4ae3-b99a-466efa74cf23'} 09/01/2025 01:35:08.027 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['namespace=kube-node-lease'], 'obj_dict': {'display_name': 'namespace=kube-node-lease', 'fq_name': ['namespace=kube-node-lease'], 'id_perms': {'created': '2025-09-01T01:35:08.016756', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:08.016756', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13078349777989594095, 'uuid_mslong': 11288639297156038718}}, 'name': 'namespace=kube-node-lease', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01010003', 'tag_type_name': 'namespace', 'tag_type_refs': [{'to': ['namespace'], 'uuid': '884e5052-64fc-44a5-a883-82d91352fa8e'}], 'tag_value': 'kube-node-lease', 'uuid': '9ca94da1-8880-403e-b57f-a1d4bd60ebef'}, 'oper': 'CREATE', 'request-id': 'req-56619a5e-043b-439e-a45a-1ae7eb3863d1', 'type': 'tag', 'uuid': '9ca94da1-8880-403e-b57f-a1d4bd60ebef'} 09/01/2025 01:35:08.080 7fb2d4601ea0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:35:08.121 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease'], 'obj_dict': {'display_name': 'k8s-kube-node-lease', 'fq_name': ['default-domain', 'k8s-kube-node-lease'], 'id_perms': {'created': '2025-09-01T01:35:08.117860', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:08.117860', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13243892127741515929, 'uuid_mslong': 10235971928760011485}}, 'parent_type': 'domain', 'parent_uuid': 'ce056a4b-12ea-41a5-896d-393d506f2011', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '8e0d7a3c-989c-4add-b7cb-c1b895a01899'}, 'oper': 'CREATE', 'request-id': 'req-67755f30-ee01-481f-82ec-6bdf3ec8ed6d', 'type': 'project', 'uuid': '8e0d7a3c-989c-4add-b7cb-c1b895a01899'} 09/01/2025 01:35:08.144 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'display_name': 'default-application-policy-set', 'fq_name': ['default-domain', 'k8s-kube-node-lease', 'default-application-policy-set'], 'id_perms': {'created': '2025-09-01T01:35:08.141506', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:08.141506', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11599686833657261955, 'uuid_mslong': 6557066945879952406}}, 'parent_type': 'project', 'parent_uuid': '8e0d7a3c-989c-4add-b7cb-c1b895a01899', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '5aff61a5-7da1-4c16-a0fa-5db7a9eaaf83'}, 'oper': 'CREATE', 'request-id': 'req-67755f30-ee01-481f-82ec-6bdf3ec8ed6d', 'type': 'application_policy_set', 'uuid': '5aff61a5-7da1-4c16-a0fa-5db7a9eaaf83'} 09/01/2025 01:35:08.162 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease'], 'oper': 'UPDATE', 'request-id': 'req-67755f30-ee01-481f-82ec-6bdf3ec8ed6d', 'type': 'project', 'uuid': '8e0d7a3c-989c-4add-b7cb-c1b895a01899'} 09/01/2025 01:35:08.243 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease', 'default'], 'obj_dict': {'display_name': 'default', 'fq_name': ['default-domain', 'k8s-kube-node-lease', 'default'], 'id_perms': {'created': '2025-09-01T01:35:08.189203', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:35:08.189203', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10355378182601732884, 'uuid_mslong': 3631824606228794343}}, 'parent_type': 'project', 'parent_uuid': '8e0d7a3c-989c-4add-b7cb-c1b895a01899', 'perms2': {'global_access': 0, 'owner': '8e0d7a3c-989c-4add-b7cb-c1b895a01899', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '1bf977a9-083f-4f52-adc5-794fce9a63e5', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-kube-node-lease:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '2393b834-6985-4b82-8b4e-39ac9c7dc3ce', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-kube-node-lease:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '1c72fa75-47db-4cb2-adee-4ab2a119da26', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'ae9fe320-160f-4589-a736-93a29502bcb9', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000008, 'uuid': '3266d53c-b4ca-4be7-8fb5-b19788ce7314'}, 'oper': 'CREATE', 'request-id': 'req-adcf92cc-3838-4d8c-b02f-1e4b7123e458', 'type': 'security_group', 'uuid': '3266d53c-b4ca-4be7-8fb5-b19788ce7314'} 09/01/2025 01:35:08.258 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease'], 'oper': 'UPDATE', 'request-id': 'req-c8dd4699-30f4-4302-8658-d1c9c7e961c2', 'type': 'project', 'uuid': '8e0d7a3c-989c-4add-b7cb-c1b895a01899'} 09/01/2025 01:35:08.501 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease', 'default', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000008', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '1bf977a9-083f-4f52-adc5-794fce9a63e5'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000008', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '2393b834-6985-4b82-8b4e-39ac9c7dc3ce'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-node-lease', 'default', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:08.443304', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:08.443304', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13779271877774155511, 'uuid_mslong': 1901039727771534284}}, 'parent_type': 'security-group', 'parent_uuid': '3266d53c-b4ca-4be7-8fb5-b19788ce7314', 'perms2': {'global_access': 0, 'owner': '8e0d7a3c-989c-4add-b7cb-c1b895a01899', 'owner_access': 7, 'share': []}, 'uuid': '1a61d98f-6dba-43cc-bf39-cec462421ef7'}, 'oper': 'CREATE', 'request-id': 'req-627a7f7f-388f-416a-bef6-8db21c7f4970', 'type': 'access_control_list', 'uuid': '1a61d98f-6dba-43cc-bf39-cec462421ef7'} 09/01/2025 01:35:08.518 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-3bda41c6-5d8b-415a-9fd7-14913639ec04', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:35:08.560 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-3bda41c6-5d8b-415a-9fd7-14913639ec04', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:35:08.613 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease', 'default', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '1c72fa75-47db-4cb2-adee-4ab2a119da26'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'ae9fe320-160f-4589-a736-93a29502bcb9'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-node-lease', 'default', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:08.552827', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:08.552827', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12223284962926760408, 'uuid_mslong': 9767097960267923502}}, 'parent_type': 'security-group', 'parent_uuid': '3266d53c-b4ca-4be7-8fb5-b19788ce7314', 'perms2': {'global_access': 0, 'owner': '8e0d7a3c-989c-4add-b7cb-c1b895a01899', 'owner_access': 7, 'share': []}, 'uuid': '878bb3d8-b836-402e-a9a1-d4e97b9f91d8'}, 'oper': 'CREATE', 'request-id': 'req-390b984d-1730-424d-bdf5-3edc2e41b892', 'type': 'access_control_list', 'uuid': '878bb3d8-b836-402e-a9a1-d4e97b9f91d8'} 09/01/2025 01:35:08.628 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-de605c4f-b2e0-41c2-9951-be9556a27795', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:35:08.645 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-de605c4f-b2e0-41c2-9951-be9556a27795', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:35:08.673 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:08.730 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease', 'k8s-kube-node-lease-default-sg'], 'obj_dict': {'display_name': 'k8s-kube-node-lease-default-sg', 'fq_name': ['default-domain', 'k8s-kube-node-lease', 'k8s-kube-node-lease-default-sg'], 'id_perms': {'created': '2025-09-01T01:35:08.671049', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:35:08.671049', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12277904507868437021, 'uuid_mslong': 17077533445816337081}}, 'parent_type': 'project', 'parent_uuid': '8e0d7a3c-989c-4add-b7cb-c1b895a01899', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '01335bfd-0746-431c-918c-c51187711b8b', 'src_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '7dae5209-fb44-4db7-9366-8c4f5e9a37b1', 'src_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '27af981d-28c1-44b2-97f0-b4212fb494b7', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '824ed245-0ba2-44e1-9f82-f7c6fe54ba48', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000009, 'uuid': 'ecff9630-35bc-42b9-aa63-e11949aa5a1d'}, 'oper': 'CREATE', 'request-id': 'req-ac7d6189-024e-4169-b43d-76c3a6d20aef', 'type': 'security_group', 'uuid': 'ecff9630-35bc-42b9-aa63-e11949aa5a1d'} 09/01/2025 01:35:08.806 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease', 'k8s-kube-node-lease-default-sg', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '01335bfd-0746-431c-918c-c51187711b8b'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '7dae5209-fb44-4db7-9366-8c4f5e9a37b1'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-node-lease', 'k8s-kube-node-lease-default-sg', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:08.756795', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:08.756795', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11466293722866954989, 'uuid_mslong': 6670521070751402776}}, 'parent_type': 'security-group', 'parent_uuid': 'ecff9630-35bc-42b9-aa63-e11949aa5a1d', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '5c927392-68e5-4b18-9f20-7563d1c6b2ed'}, 'oper': 'CREATE', 'request-id': 'req-f69b0936-4451-4dea-ad2e-7fc5f9534daf', 'type': 'access_control_list', 'uuid': '5c927392-68e5-4b18-9f20-7563d1c6b2ed'} 09/01/2025 01:35:08.842 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_security_group_id': None}, 'fq_name': ['default-domain', 'k8s-kube-node-lease', 'k8s-kube-node-lease-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-877457c7-d08c-4c98-99ac-53ff0411afdc', 'type': 'security_group', 'uuid': 'ecff9630-35bc-42b9-aa63-e11949aa5a1d'} 09/01/2025 01:35:08.881 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease', 'k8s-kube-node-lease-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-26beae75-376d-42fc-a43f-c3482dc143d1', 'type': 'security_group', 'uuid': 'ecff9630-35bc-42b9-aa63-e11949aa5a1d'} 09/01/2025 01:35:08.952 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-node-lease', 'k8s-kube-node-lease-default-sg', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '27af981d-28c1-44b2-97f0-b4212fb494b7'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '824ed245-0ba2-44e1-9f82-f7c6fe54ba48'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-node-lease', 'k8s-kube-node-lease-default-sg', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:08.901065', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:08.901065', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12329592412285012411, 'uuid_mslong': 51089021332179352}}, 'parent_type': 'security-group', 'parent_uuid': 'ecff9630-35bc-42b9-aa63-e11949aa5a1d', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '00b58131-b86d-4998-ab1b-82f9579989bb'}, 'oper': 'CREATE', 'request-id': 'req-3d943d03-6797-4d8a-bd47-f83455eca619', 'type': 'access_control_list', 'uuid': '00b58131-b86d-4998-ab1b-82f9579989bb'} 09/01/2025 01:35:09.126 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-kube-node-lease-ingress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-kube-node-lease-ingress', 'endpoint_1': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842755], 'tags': ['namespace=kube-node-lease'], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-kube-node-lease-ingress'], 'id_perms': {'created': '2025-09-01T01:35:09.068780', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:09.068780', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9791100812219705833, 'uuid_mslong': 17402610047194647621}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=kube-node-lease'], 'uuid': '9ca94da1-8880-403e-b57f-a1d4bd60ebef'}], 'uuid': 'f1827da2-8bae-4c45-87e0-fa503064e9e9'}, 'oper': 'CREATE', 'request-id': 'req-bb6fa775-a0ca-48ca-8b64-5f578ab02999', 'type': 'firewall_rule', 'uuid': 'f1827da2-8bae-4c45-87e0-fa503064e9e9'} 09/01/2025 01:35:09.205 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-e7805a5b-0948-4ef5-801c-53f81f0cf097', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:09.384 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-kube-node-lease-egress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-kube-node-lease-egress', 'endpoint_1': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842755], 'tags': ['namespace=kube-node-lease'], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-kube-node-lease-egress'], 'id_perms': {'created': '2025-09-01T01:35:09.334663', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:09.334663', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11673476119293380291, 'uuid_mslong': 16111642645617723340}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=kube-node-lease'], 'uuid': '9ca94da1-8880-403e-b57f-a1d4bd60ebef'}], 'uuid': 'df980d9f-8014-47cc-a200-84ae887cc6c3'}, 'oper': 'CREATE', 'request-id': 'req-4ab8947c-05ac-452c-af37-fcdf76759d32', 'type': 'firewall_rule', 'uuid': 'df980d9f-8014-47cc-a200-84ae887cc6c3'} 09/01/2025 01:35:09.499 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-9e6d47a6-1950-4eec-81b8-2065014e081b', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:09.533 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kubernetes.io__slash__metadata.name=kube-public'], 'obj_dict': {'display_name': 'kubernetes.io__slash__metadata.name=kube-public', 'fq_name': ['kubernetes.io__slash__metadata.name=kube-public'], 'id_perms': {'created': '2025-09-01T01:35:09.525668', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:09.525668', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12857215920637343278, 'uuid_mslong': 6157200344163633711}}, 'name': 'kubernetes.io__slash__metadata.name=kube-public', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01020003', 'tag_type_name': 'kubernetes.io__slash__metadata.name', 'tag_type_refs': [{'to': ['kubernetes.io__slash__metadata.name'], 'uuid': 'c4c51d7c-32fa-45a0-bfe9-26e1923cb4f6'}], 'tag_value': 'kube-public', 'uuid': '5572c517-3cc9-4a2f-b26e-01c26615f62e'}, 'oper': 'CREATE', 'request-id': 'req-4378319e-3e3b-4973-b6fa-04b78261c136', 'type': 'tag', 'uuid': '5572c517-3cc9-4a2f-b26e-01c26615f62e'} 09/01/2025 01:35:09.620 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['namespace=kube-public'], 'obj_dict': {'display_name': 'namespace=kube-public', 'fq_name': ['namespace=kube-public'], 'id_perms': {'created': '2025-09-01T01:35:09.612231', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:09.612231', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11728912746587169791, 'uuid_mslong': 17558590392535762952}}, 'name': 'namespace=kube-public', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01010004', 'tag_type_name': 'namespace', 'tag_type_refs': [{'to': ['namespace'], 'uuid': '884e5052-64fc-44a5-a883-82d91352fa8e'}], 'tag_value': 'kube-public', 'uuid': 'f3aca4ee-bfae-4808-a2c5-780025e123ff'}, 'oper': 'CREATE', 'request-id': 'req-ca3d8c77-1039-413f-9d2b-b53c4a26afe7', 'type': 'tag', 'uuid': 'f3aca4ee-bfae-4808-a2c5-780025e123ff'} 09/01/2025 01:35:09.678 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:09.716 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public'], 'obj_dict': {'display_name': 'k8s-kube-public', 'fq_name': ['default-domain', 'k8s-kube-public'], 'id_perms': {'created': '2025-09-01T01:35:09.709338', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:09.709338', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12382982719713215992, 'uuid_mslong': 1059935213013714696}}, 'parent_type': 'domain', 'parent_uuid': 'ce056a4b-12ea-41a5-896d-393d506f2011', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '0eb5a575-e09c-4708-abd9-312cfc4e85f8'}, 'oper': 'CREATE', 'request-id': 'req-69797a7b-9f8e-4b7f-a6af-3652d2ea5c0d', 'type': 'project', 'uuid': '0eb5a575-e09c-4708-abd9-312cfc4e85f8'} 09/01/2025 01:35:09.751 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'display_name': 'default-application-policy-set', 'fq_name': ['default-domain', 'k8s-kube-public', 'default-application-policy-set'], 'id_perms': {'created': '2025-09-01T01:35:09.744535', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:09.744535', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9582523444762837509, 'uuid_mslong': 5637291694719647816}}, 'parent_type': 'project', 'parent_uuid': '0eb5a575-e09c-4708-abd9-312cfc4e85f8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '4e3baeed-bf06-4048-84fb-f64d78f10205'}, 'oper': 'CREATE', 'request-id': 'req-69797a7b-9f8e-4b7f-a6af-3652d2ea5c0d', 'type': 'application_policy_set', 'uuid': '4e3baeed-bf06-4048-84fb-f64d78f10205'} 09/01/2025 01:35:09.770 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public'], 'oper': 'UPDATE', 'request-id': 'req-69797a7b-9f8e-4b7f-a6af-3652d2ea5c0d', 'type': 'project', 'uuid': '0eb5a575-e09c-4708-abd9-312cfc4e85f8'} 09/01/2025 01:35:09.861 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public', 'default'], 'obj_dict': {'display_name': 'default', 'fq_name': ['default-domain', 'k8s-kube-public', 'default'], 'id_perms': {'created': '2025-09-01T01:35:09.803936', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:35:09.803936', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10347208463162891061, 'uuid_mslong': 4265717819942062928}}, 'parent_type': 'project', 'parent_uuid': '0eb5a575-e09c-4708-abd9-312cfc4e85f8', 'perms2': {'global_access': 0, 'owner': '0eb5a575-e09c-4708-abd9-312cfc4e85f8', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '89a68178-7737-4108-80a0-4986bfcd3106', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-kube-public:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '9c3b6f70-ae91-47c8-9df3-67b2252ae2e5', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:k8s-kube-public:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '67b96713-a84f-4494-b1c6-c2c2977ce9aa', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '84c84276-8154-458c-8198-d0d82912d3e2', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000010, 'uuid': '3b32dfc1-a9b3-4b50-8f98-ab467fbd5b35'}, 'oper': 'CREATE', 'request-id': 'req-5b85b15d-7427-4962-8c7d-ac5d9951d4dc', 'type': 'security_group', 'uuid': '3b32dfc1-a9b3-4b50-8f98-ab467fbd5b35'} 09/01/2025 01:35:09.961 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public', 'default', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000010', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '89a68178-7737-4108-80a0-4986bfcd3106'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000010', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '9c3b6f70-ae91-47c8-9df3-67b2252ae2e5'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-public', 'default', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:09.901575', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:09.901575', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10631142203170786979, 'uuid_mslong': 10153433766146494016}}, 'parent_type': 'security-group', 'parent_uuid': '3b32dfc1-a9b3-4b50-8f98-ab467fbd5b35', 'perms2': {'global_access': 0, 'owner': '0eb5a575-e09c-4708-abd9-312cfc4e85f8', 'owner_access': 7, 'share': []}, 'uuid': '8ce83e37-119e-4e40-9389-6781f0a88ea3'}, 'oper': 'CREATE', 'request-id': 'req-b2df4bdd-510a-4cec-859a-569a47bede46', 'type': 'access_control_list', 'uuid': '8ce83e37-119e-4e40-9389-6781f0a88ea3'} 09/01/2025 01:35:09.978 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public'], 'oper': 'UPDATE', 'request-id': 'req-0d9c0810-b84e-4dc7-8de0-7749d2662d96', 'type': 'project', 'uuid': '0eb5a575-e09c-4708-abd9-312cfc4e85f8'} 09/01/2025 01:35:10.073 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-336387db-eb60-4c6f-b119-859f4528e9b5', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:35:10.145 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public', 'default', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '67b96713-a84f-4494-b1c6-c2c2977ce9aa'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '84c84276-8154-458c-8198-d0d82912d3e2'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-public', 'default', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:10.087967', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:10.087967', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13567071936738506524, 'uuid_mslong': 10770495866812713647}}, 'parent_type': 'security-group', 'parent_uuid': '3b32dfc1-a9b3-4b50-8f98-ab467fbd5b35', 'perms2': {'global_access': 0, 'owner': '0eb5a575-e09c-4708-abd9-312cfc4e85f8', 'owner_access': 7, 'share': []}, 'uuid': '95787ced-242f-4aaf-bc47-ec0b8778371c'}, 'oper': 'CREATE', 'request-id': 'req-10689d71-6487-4a8e-8116-c61e7f4b0245', 'type': 'access_control_list', 'uuid': '95787ced-242f-4aaf-bc47-ec0b8778371c'} 09/01/2025 01:35:10.149 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-336387db-eb60-4c6f-b119-859f4528e9b5', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:35:10.205 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-0e66adc2-242b-42f1-9769-0e79d035d3a3', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:35:10.228 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-0e66adc2-242b-42f1-9769-0e79d035d3a3', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:35:10.328 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public', 'k8s-kube-public-default-sg'], 'obj_dict': {'display_name': 'k8s-kube-public-default-sg', 'fq_name': ['default-domain', 'k8s-kube-public', 'k8s-kube-public-default-sg'], 'id_perms': {'created': '2025-09-01T01:35:10.267151', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-09-01T01:35:10.267151', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12841608011934621753, 'uuid_mslong': 4609916113583950431}}, 'parent_type': 'project', 'parent_uuid': '0eb5a575-e09c-4708-abd9-312cfc4e85f8', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '14e9c1ba-6529-4291-bf18-e7857b87aab3', 'src_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '1afc35ea-9414-4d93-8c2b-028e2d41e118', 'src_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'c2ea3148-20d1-4715-9670-bc1f2d678de9', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '84d3d5d3-f956-4e38-a9e1-e3f1b77f0521', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000011, 'uuid': '3ff9b647-ea85-4a5f-b236-8e72f82c6039'}, 'oper': 'CREATE', 'request-id': 'req-22391dd1-b0ec-43b0-bc2b-a3ce20ed6755', 'type': 'security_group', 'uuid': '3ff9b647-ea85-4a5f-b236-8e72f82c6039'} 09/01/2025 01:35:10.345 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_security_group_id': None}, 'fq_name': ['default-domain', 'k8s-kube-public', 'k8s-kube-public-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-7f54334e-d06d-4159-923c-4e9e6e78bcd1', 'type': 'security_group', 'uuid': '3ff9b647-ea85-4a5f-b236-8e72f82c6039'} 09/01/2025 01:35:10.365 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public', 'k8s-kube-public-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-d20e9dc9-64db-45da-8c5e-3d79e8f31f69', 'type': 'security_group', 'uuid': '3ff9b647-ea85-4a5f-b236-8e72f82c6039'} 09/01/2025 01:35:10.444 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public', 'k8s-kube-public-default-sg', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '14e9c1ba-6529-4291-bf18-e7857b87aab3'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '1afc35ea-9414-4d93-8c2b-028e2d41e118'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-public', 'k8s-kube-public-default-sg', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:10.386974', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:10.386974', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13390437058598049228, 'uuid_mslong': 5502608932187098816}}, 'parent_type': 'security-group', 'parent_uuid': '3ff9b647-ea85-4a5f-b236-8e72f82c6039', 'perms2': {'global_access': 0, 'owner': 'None', 'owner_access': 7, 'share': []}, 'uuid': '4c5d31ab-74e7-4ec0-b9d4-638f28f695cc'}, 'oper': 'CREATE', 'request-id': 'req-e64d83b6-7531-49c9-ba60-e2c61eb819a2', 'type': 'access_control_list', 'uuid': '4c5d31ab-74e7-4ec0-b9d4-638f28f695cc'} 09/01/2025 01:35:10.547 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-public', 'k8s-kube-public-default-sg', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'c2ea3148-20d1-4715-9670-bc1f2d678de9'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '84d3d5d3-f956-4e38-a9e1-e3f1b77f0521'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'k8s-kube-public', 'k8s-kube-public-default-sg', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:35:10.498098', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:10.498098', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13038786667139761078, 'uuid_mslong': 14716788366151010158}}, 'parent_type': 'security-group', 'parent_uuid': '3ff9b647-ea85-4a5f-b236-8e72f82c6039', 'perms2': {'global_access': 0, 'owner': '0eb5a575-e09c-4708-abd9-312cfc4e85f8', 'owner_access': 7, 'share': []}, 'uuid': 'cc3c890b-cf08-476e-b4f3-13642cf703b6'}, 'oper': 'CREATE', 'request-id': 'req-70d96687-406b-47d9-919b-c0e5eb49f2de', 'type': 'access_control_list', 'uuid': 'cc3c890b-cf08-476e-b4f3-13642cf703b6'} 09/01/2025 01:35:10.679 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:10.769 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-kube-public-ingress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-kube-public-ingress', 'endpoint_1': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842756], 'tags': ['namespace=kube-public'], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-kube-public-ingress'], 'id_perms': {'created': '2025-09-01T01:35:10.711118', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:10.711118', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10607826179290505792, 'uuid_mslong': 13188655992088249721}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=kube-public'], 'uuid': 'f3aca4ee-bfae-4808-a2c5-780025e123ff'}], 'uuid': 'b70784bf-913f-4579-9336-91b517b32240'}, 'oper': 'CREATE', 'request-id': 'req-49b6e189-d5b9-4351-9c22-d694d7476369', 'type': 'firewall_rule', 'uuid': 'b70784bf-913f-4579-9336-91b517b32240'} 09/01/2025 01:35:10.887 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-d3290e7e-7c81-444e-8025-4446899997ac', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:10.956 7fb2d4601040 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:10.958 7fb2d4601040 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:10.958 7fb2d4601040 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:10.958 7fb2d4601040 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:10.959 7fb2d4601040 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:10.959 7fb2d4601040 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:10.959 7fb2d4601040 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:10.959 7fb2d4601040 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:10.959 7fb2d4601040 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:10.959 7fb2d4601040 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:10.959 7fb2d4601040 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:10.960 7fb2d4601040 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:10.961 7fb2d4601040 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:10.961 7fb2d4601040 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:11.084 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-kube-public-egress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-kube-public-egress', 'endpoint_1': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842756], 'tags': ['namespace=kube-public'], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-kube-public-egress'], 'id_perms': {'created': '2025-09-01T01:35:11.034553', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:11.034553', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12687764789551225607, 'uuid_mslong': 7321813596295873554}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=kube-public'], 'uuid': 'f3aca4ee-bfae-4808-a2c5-780025e123ff'}], 'uuid': '659c4eac-56d7-4412-b013-feda7ae8db07'}, 'oper': 'CREATE', 'request-id': 'req-d04bb5ab-e8db-4ce0-9dcb-da64fd7f9641', 'type': 'firewall_rule', 'uuid': '659c4eac-56d7-4412-b013-feda7ae8db07'} 09/01/2025 01:35:11.245 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-c9cfc777-6c6e-4025-a0f0-2046f5cc631e', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:11.294 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['kubernetes.io__slash__metadata.name=kube-system'], 'obj_dict': {'display_name': 'kubernetes.io__slash__metadata.name=kube-system', 'fq_name': ['kubernetes.io__slash__metadata.name=kube-system'], 'id_perms': {'created': '2025-09-01T01:35:11.284227', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:11.284227', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13811631599716858853, 'uuid_mslong': 8548833652210091014}}, 'name': 'kubernetes.io__slash__metadata.name=kube-system', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_id': '0x01020004', 'tag_type_name': 'kubernetes.io__slash__metadata.name', 'tag_type_refs': [{'to': ['kubernetes.io__slash__metadata.name'], 'uuid': 'c4c51d7c-32fa-45a0-bfe9-26e1923cb4f6'}], 'tag_value': 'kube-system', 'uuid': '76a38ee9-bbe3-4406-bfac-c5c345aefbe5'}, 'oper': 'CREATE', 'request-id': 'req-4b8f40b3-4cd2-4cca-8a4d-9bb8bf2211f4', 'type': 'tag', 'uuid': '76a38ee9-bbe3-4406-bfac-c5c345aefbe5'} 09/01/2025 01:35:11.499 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system'], 'oper': 'UPDATE', 'request-id': 'req-f03f9d16-99fd-49ac-830d-989a5482057c', 'type': 'project', 'uuid': 'a5dc0037-9655-44b1-8af6-f013fea66ee0'} 09/01/2025 01:35:11.591 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-1e81e314-b72a-41a5-9d7a-1d919389fb88', 'type': 'virtual_network', 'uuid': 'd650e01f-39d4-4eb1-91f8-ca54373fcba6'} 09/01/2025 01:35:11.615 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-pod-network', 'k8s-default-pod-network'], 'oper': 'UPDATE', 'request-id': 'req-1e81e314-b72a-41a5-9d7a-1d919389fb88', 'type': 'routing_instance', 'uuid': '5fa5f383-4684-4ec5-88cc-18491581bc2e'} 09/01/2025 01:35:11.670 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-e53f458c-8756-4e94-bbf6-1fa599f7e4b4', 'type': 'virtual_network', 'uuid': 'a6c41605-29b5-4568-a40b-17e3f103c269'} 09/01/2025 01:35:11.680 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:11.692 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-default', 'k8s-default-service-network', 'k8s-default-service-network'], 'oper': 'UPDATE', 'request-id': 'req-e53f458c-8756-4e94-bbf6-1fa599f7e4b4', 'type': 'routing_instance', 'uuid': 'a099888b-9d11-4587-8b98-4d1673309c9e'} 09/01/2025 01:35:11.820 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_security_group_id': None}, 'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-c5c73fdb-c44a-450f-a44a-0ad4bdee763f', 'type': 'security_group', 'uuid': 'e0fa3e04-8145-47f6-9b69-718272132295'} 09/01/2025 01:35:11.854 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'extra_dict': {'deallocated_security_group_id': None}, 'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg'], 'oper': 'UPDATE', 'request-id': 'req-f4377f5a-1796-4fa8-b1ea-fb62420a7ca8', 'type': 'security_group', 'uuid': 'e0fa3e04-8145-47f6-9b69-718272132295'} 09/01/2025 01:35:11.863 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-f66c4fd0-b770-4d76-99e7-c8fd6bbfe945', 'type': 'access_control_list', 'uuid': '299bf655-b7a5-41e2-877c-35bccfef2eda'} 09/01/2025 01:35:11.879 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'k8s-kube-system-default-sg', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-1b59da51-eaa3-4e2f-8896-b8802e3a3132', 'type': 'access_control_list', 'uuid': '448ddfc1-0480-4786-9b61-9816732b043b'} 09/01/2025 01:35:12.057 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-kube-system-ingress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-kube-system-ingress', 'endpoint_1': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842752], 'tags': ['namespace=kube-system'], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-kube-system-ingress'], 'id_perms': {'created': '2025-09-01T01:35:12.005815', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:12.005815', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12917800681854254437, 'uuid_mslong': 9121708868258582194}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=kube-system'], 'uuid': '317d6be2-b0aa-4cee-87d2-56074b8ba3b1'}], 'uuid': '7e96d1e3-0515-4eb2-b345-3f475938bd65'}, 'oper': 'CREATE', 'request-id': 'req-a571d2ec-12f7-40d9-a141-8aa030568bcc', 'type': 'firewall_rule', 'uuid': '7e96d1e3-0515-4eb2-b345-3f475938bd65'} 09/01/2025 01:35:12.125 7fb2d4601e00 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:35:12.196 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-cd5f9f37-b7fe-4e40-bd9d-4d0cf7581682', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:12.527 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-Namespace-kube-system-egress'], 'obj_dict': {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': '>', 'display_name': 'k8s-Namespace-kube-system-egress', 'endpoint_1': {'address_group': None, 'any': None, 'subnet': None, 'tag_ids': [16842752], 'tags': ['namespace=kube-system'], 'virtual_network': None}, 'endpoint_2': {'address_group': None, 'any': True, 'subnet': None, 'tag_ids': [], 'tags': [], 'virtual_network': None}, 'fq_name': ['default-policy-management', 'k8s-Namespace-kube-system-egress'], 'id_perms': {'created': '2025-09-01T01:35:12.470619', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:12.470619', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11622934083351091608, 'uuid_mslong': 14421497729005404891}}, 'match_tag_types': {'tag_type': [1]}, 'parent_type': 'policy-management', 'parent_uuid': '4a4fd292-14a2-4148-9861-3579ce70f727', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service': {'dst_ports': {'end_port': 65535, 'start_port': 0}, 'protocol': 'any', 'protocol_id': 0, 'src_ports': None}, 'tag_refs': [{'to': ['namespace=kube-system'], 'uuid': '317d6be2-b0aa-4cee-87d2-56074b8ba3b1'}], 'uuid': 'c82373c6-b278-42db-a14c-f4f7c5ec1998'}, 'oper': 'CREATE', 'request-id': 'req-fa8d65a1-5ce9-40f7-90e7-60e71d67ac20', 'type': 'firewall_rule', 'uuid': 'c82373c6-b278-42db-a14c-f4f7c5ec1998'} 09/01/2025 01:35:12.662 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-policy-management', 'k8s-allowall'], 'oper': 'UPDATE', 'request-id': 'req-cc473e95-bceb-4aee-a9bb-72ffb67a594f', 'type': 'firewall_policy', 'uuid': 'aebd7f43-362b-4543-a3a3-c56771bd18d7'} 09/01/2025 01:35:12.681 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:12.811 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'k8s-kube-system', 'coredns-6f867cd986-wlkqx__e02048c4-86d3-11f0-93e1-fa163e599e0d'], 'oper': 'UPDATE', 'request-id': 'req-fd135d25-ba94-42ee-a11e-0478c91d7bdf', 'type': 'virtual_machine_interface', 'uuid': 'e02048c4-86d3-11f0-93e1-fa163e599e0d'} 09/01/2025 01:35:13.682 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:14.683 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:14.960 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:14.961 7fb2d4601cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:14.961 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:14.961 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:14.961 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:14.961 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:14.961 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:14.962 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:14.962 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:14.962 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:14.962 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:14.962 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:14.962 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:14.962 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:15.685 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:16.686 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:17.688 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:18.689 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:18.961 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:18.962 7fb2d4601cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:18.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:19.691 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:20.692 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:21.692 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:22.694 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:22.963 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:22.965 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:22.966 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:22.966 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:22.966 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:23.697 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:24.698 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:25.700 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:26.701 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:26.966 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:26.967 7fb2d4601cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:26.967 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:26.967 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:26.967 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:26.967 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:26.967 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:26.967 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:26.967 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:26.967 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:26.968 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:26.968 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:26.968 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:26.968 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:27.702 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:28.704 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:29.705 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:30.706 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:30.967 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:30.968 7fb2d4601cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:30.968 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:30.968 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:30.968 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:30.968 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:30.968 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:30.969 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:30.969 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:30.969 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:30.969 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:30.969 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:30.969 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:30.969 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:31.708 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:32.709 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:33.711 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:34.713 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:34.969 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:34.970 7fb2d4601cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:34.970 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:34.971 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:34.971 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:34.971 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:34.971 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:34.971 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:34.971 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:34.971 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:34.971 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:34.972 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:34.972 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:34.972 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:35.715 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:36.716 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:37.719 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:38.720 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:38.971 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:38.973 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:38.974 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:38.974 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:39.722 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:40.724 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:41.725 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:42.726 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:42.973 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:42.974 7fb2d4601cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:42.974 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:42.974 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:42.974 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:42.974 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:42.974 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:42.975 7fb2d4601cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:42.975 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:42.975 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:42.975 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:42.975 7fb2d4601cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:42.975 7fb2d4601cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:42.975 7fb2d4601cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:43.728 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:44.728 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:45.729 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:46.730 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:46.975 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:46.978 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:46.978 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:46.978 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:46.978 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:46.978 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:46.978 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:46.979 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:46.979 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:46.979 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:46.979 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:46.979 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:46.979 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:46.979 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:47.732 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:48.734 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:49.501 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-5c9a772d-a744-45b7-80ef-09a53d7ad23d', 'type': 'global_system_config', 'uuid': '70eaa5ad-608f-40c9-a193-2be391842efd'} 09/01/2025 01:35:49.572 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-juju-k8s-1454-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-juju-k8s-1454-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-juju-k8s-1454-1'], 'id_perms': {'created': '2025-09-01T01:35:49.567966', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:49.567966', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10794658036228347919, 'uuid_mslong': 12163681958422269707}}, 'parent_type': 'global-system-config', 'parent_uuid': '70eaa5ad-608f-40c9-a193-2be391842efd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a8ce144b-9496-4f0b-95ce-544a9934d80f', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.0.0.22'}, 'oper': 'CREATE', 'request-id': 'req-ee08329c-5872-4f7a-b645-2f27e34a25a4', 'type': 'virtual_router', 'uuid': 'a8ce144b-9496-4f0b-95ce-544a9934d80f'} 09/01/2025 01:35:49.680 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-juju-k8s-1454-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-juju-k8s-1454-1', 'vhost0'], 'id_perms': {'created': '2025-09-01T01:35:49.668311', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:35:49.668311', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12472940248073749293, 'uuid_mslong': 15418220656626518203}}, 'parent_type': 'virtual-router', 'parent_uuid': 'a8ce144b-9496-4f0b-95ce-544a9934d80f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd5f885ff-7ad0-48bb-ad18-c912371bc32d', 'virtual_machine_interface_disable_policy': False, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:d5:f8:85:ff:7a']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'e07e6e04-4e93-4043-ab83-32b8f8854bbe'}]}, 'oper': 'CREATE', 'request-id': 'req-f6bff454-c5c2-4c20-b305-c5e32915e30b', 'type': 'virtual_machine_interface', 'uuid': 'd5f885ff-7ad0-48bb-ad18-c912371bc32d'} 09/01/2025 01:35:49.704 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-juju-k8s-1454-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-f6bff454-c5c2-4c20-b305-c5e32915e30b', 'type': 'virtual_machine_interface', 'uuid': 'd5f885ff-7ad0-48bb-ad18-c912371bc32d'} 09/01/2025 01:35:49.735 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:50.736 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:50.978 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:50.979 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:50.979 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:50.980 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:51.737 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:52.738 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:53.740 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:54.741 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:54.980 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:54.981 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:54.981 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:54.981 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:54.981 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:54.981 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:54.981 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:54.982 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:54.982 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:54.982 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:54.982 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:54.982 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:54.982 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:54.982 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:55.742 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:56.744 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:57.745 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:58.746 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:35:58.982 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:35:58.983 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:35:58.983 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:35:58.983 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:58.983 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:35:58.983 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:35:58.983 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:35:58.983 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:35:58.984 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:58.984 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:35:58.984 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:58.984 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:58.984 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:35:58.984 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:35:59.748 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:00.749 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:01.750 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:02.752 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:02.983 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:02.984 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:02.985 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:02.986 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:03.754 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:04.755 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:05.758 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:06.760 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:06.985 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:06.986 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:06.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:07.761 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:08.762 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:09.763 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:10.764 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:10.987 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:10.988 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:10.989 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:10.989 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:10.989 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:11.766 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:12.767 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:13.767 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:14.769 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:14.989 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:14.990 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:14.991 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:14.991 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:14.991 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:15.770 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:16.771 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:17.773 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:18.774 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:18.991 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:18.992 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:18.992 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:18.992 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:18.992 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:18.992 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:18.992 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:18.992 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:18.992 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:18.993 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:18.993 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:18.993 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:18.993 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:18.993 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:19.776 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:20.777 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:21.778 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:22.779 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:22.992 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:22.993 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:22.994 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:22.995 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:23.780 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:24.781 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:25.782 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:26.784 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:26.994 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:26.995 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:26.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:27.785 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:28.786 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:29.788 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:30.789 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:30.996 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:31.036 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:31.037 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:31.038 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:31.790 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:32.792 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:33.793 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:34.794 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:35.037 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:35.038 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:35.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:35.795 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:36.797 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:37.798 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:38.799 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:39.039 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:39.040 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:39.040 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:39.040 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:39.040 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:39.040 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:39.041 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:39.041 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:39.041 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:39.041 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:39.041 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:39.041 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:39.041 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:39.041 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:39.801 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:40.680 7fb2d4ff1860 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:36:40.802 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:41.803 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:42.805 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:43.041 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:43.042 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:43.042 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:43.042 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:43.042 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:43.042 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:43.042 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:43.042 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:43.042 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:43.043 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:43.043 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:43.043 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:43.043 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:43.043 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:43.806 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:44.808 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:45.809 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:46.810 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:47.043 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:47.044 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:47.045 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:47.045 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:47.812 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:48.813 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:49.814 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:50.815 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:51.044 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:51.045 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:51.045 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:51.045 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:51.045 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:51.045 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:51.045 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:51.046 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:51.046 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:51.046 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:51.046 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:51.046 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:51.046 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:51.046 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:51.817 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:52.818 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:53.819 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:54.820 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:55.046 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:55.047 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:55.047 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:55.047 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:55.047 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:55.047 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:55.047 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:55.048 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:55.048 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:55.048 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:55.048 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:55.048 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:55.048 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:55.048 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:55.821 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:56.823 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:57.824 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:58.825 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:36:59.048 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:59.049 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:59.050 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:36:59.050 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:36:59.826 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:00.828 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:01.829 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:02.830 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:03.050 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:03.054 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:03.054 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:03.054 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:03.054 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:03.054 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:03.054 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:03.055 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:03.055 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:03.055 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:03.055 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:03.055 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:03.055 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:03.055 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:03.832 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:04.833 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:05.834 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:06.835 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:07.055 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:07.056 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:07.056 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:07.056 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:07.056 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:07.056 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:07.057 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:07.057 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:07.057 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:07.057 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:07.057 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:07.057 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:07.057 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:07.057 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:07.836 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:08.838 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:09.839 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:10.840 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:11.057 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:11.058 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:11.058 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:11.058 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:11.058 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:11.058 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:11.058 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:11.059 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:11.059 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:11.059 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:11.059 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:11.059 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:11.059 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:11.059 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:11.840 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:12.842 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:13.843 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:14.844 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:15.059 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:15.060 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:15.060 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:15.061 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:15.846 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:16.848 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:17.849 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:18.850 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:19.061 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:19.062 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:19.062 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:19.062 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:19.062 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:19.062 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:19.063 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:19.063 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:19.063 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:19.063 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:19.063 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:19.063 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:19.063 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:19.063 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:19.851 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:20.852 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:21.853 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:22.854 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:23.063 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:23.064 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:23.064 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:23.064 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:23.064 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:23.064 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:23.065 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:23.065 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:23.065 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:23.065 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:23.065 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:23.065 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:23.065 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:23.065 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:23.855 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:24.856 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:25.857 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:26.276 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-juju-k8s-1454-1'], 'oper': 'UPDATE', 'request-id': 'req-289c98ce-ddb2-46fa-a5f5-966a1b563ad8', 'type': 'virtual_router', 'uuid': 'a8ce144b-9496-4f0b-95ce-544a9934d80f'} 09/01/2025 01:37:26.346 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-juju-k8s-1454-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-b7f2219d-1994-43ae-91a0-48b4f5976fda', 'type': 'virtual_machine_interface', 'uuid': 'd5f885ff-7ad0-48bb-ad18-c912371bc32d'} 09/01/2025 01:37:26.859 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:27.065 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:27.066 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:27.067 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:27.067 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:27.861 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:28.862 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:29.864 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:30.865 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:31.066 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:31.067 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:31.067 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:31.067 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:31.067 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:31.067 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:31.067 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:31.067 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:31.068 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:31.068 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:31.068 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:31.068 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:31.068 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:31.068 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:31.867 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:32.868 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:33.870 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:34.872 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:35.067 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:35.068 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:35.068 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:35.068 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:35.068 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:35.068 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:35.068 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:35.069 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:35.069 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:35.069 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:35.069 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:35.069 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:35.069 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:35.069 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:35.872 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:36.874 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:37.874 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:38.876 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:39.069 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:39.070 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:39.070 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:39.070 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:39.070 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:39.071 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:39.071 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:39.071 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:39.071 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:39.071 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:39.071 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:39.071 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:39.071 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:39.071 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:39.878 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:40.880 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:41.882 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:42.883 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:43.071 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:43.072 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:43.073 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:43.073 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:43.884 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:44.886 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:45.888 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:46.889 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:47.072 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:47.073 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:47.073 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:47.074 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:47.890 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:48.892 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:49.893 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:50.895 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:51.075 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:51.076 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:51.076 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:51.076 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:51.076 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:51.076 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:51.076 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:51.076 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:51.076 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:51.077 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:51.077 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:51.077 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:51.077 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:51.077 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:51.897 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:52.898 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:53.900 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:54.901 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:55.076 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:55.077 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:55.078 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:55.078 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:55.078 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:55.078 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:55.078 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:55.078 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:55.078 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:55.079 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:55.079 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:55.079 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:55.079 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:55.079 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:55.533 7fb2d4ff1860 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:37:55.903 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:56.904 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:57.891 7fb2d4ff1860 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:37:57.904 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:58.906 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:37:59.078 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:37:59.079 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:37:59.079 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:37:59.079 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:37:59.080 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:37:59.907 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:00.909 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:01.400 7fb2d4ff1860 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:38:01.911 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:02.912 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:03.080 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:03.081 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:03.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:03.913 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:04.914 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:05.916 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:06.918 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:07.082 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:07.083 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:07.084 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:07.084 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:07.919 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:08.921 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:09.923 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:10.924 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:11.084 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:11.085 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:11.085 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:11.085 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:11.085 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:11.085 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:11.085 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:11.086 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:11.086 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:11.086 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:11.086 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:11.086 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:11.086 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:11.086 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:11.925 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:12.926 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:13.928 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:14.930 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:15.085 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:15.087 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:15.088 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:15.088 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:15.088 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:15.932 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:16.933 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:17.935 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:18.936 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:19.088 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:19.089 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:19.089 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:19.089 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:19.089 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:19.089 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:19.089 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:19.090 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:19.090 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:19.090 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:19.090 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:19.090 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:19.090 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:19.090 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:19.938 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:20.939 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:21.941 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:22.942 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:23.089 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:23.090 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:23.091 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:23.091 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:23.091 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:23.091 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:23.091 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:23.091 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:23.091 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:23.091 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:23.092 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:23.092 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:23.092 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:23.092 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:23.943 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:24.944 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:25.945 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:26.947 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:27.091 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:27.092 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:27.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:27.949 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:28.950 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:29.952 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:30.953 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:31.093 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:31.094 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:31.094 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:31.094 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:31.094 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:31.095 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:31.095 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:31.095 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:31.095 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:31.095 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:31.095 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:31.095 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:31.095 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:31.095 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:31.955 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:32.956 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:33.958 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:34.958 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:35.095 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:35.096 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:35.096 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:35.096 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:35.096 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:35.096 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:35.096 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:35.097 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:35.097 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:35.097 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:35.097 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:35.097 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:35.097 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:35.097 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:35.960 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:36.961 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:37.962 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:38.964 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:39.097 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:39.098 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:39.098 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:39.098 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:39.098 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:39.098 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:39.098 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:39.098 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:39.098 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:39.098 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:39.099 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:39.099 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:39.099 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:39.099 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:39.966 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:40.966 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:41.967 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:42.969 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:43.099 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:43.100 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:43.100 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:43.100 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:43.100 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:43.100 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:43.100 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:43.101 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:43.101 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:43.101 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:43.101 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:43.101 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:43.101 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:43.101 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:43.971 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:44.973 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:45.974 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:46.976 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:47.100 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:47.101 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:47.101 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:47.101 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:47.101 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:47.101 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:47.102 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:47.102 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:47.102 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:47.102 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:47.102 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:47.102 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:47.102 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:47.102 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:47.978 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:48.978 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:49.980 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:50.981 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:51.102 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:51.103 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:51.103 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:51.103 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:51.103 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:51.103 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:51.103 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:51.104 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:51.104 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:51.104 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:51.104 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:51.104 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:51.104 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:51.104 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:51.983 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:52.984 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:53.986 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:54.988 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:55.103 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:55.104 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:55.104 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:55.104 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:55.105 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:55.988 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:56.990 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:57.990 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:58.992 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:38:59.105 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:38:59.106 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:38:59.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:38:59.994 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:00.995 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:01.997 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:02.998 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:03.107 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:03.108 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:03.108 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:03.109 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:03.110 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:04.000 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:05.001 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:06.003 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:07.004 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:07.109 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:07.110 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:07.110 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:07.110 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:07.110 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:07.110 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:07.111 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:07.111 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:07.111 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:07.111 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:07.111 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:07.111 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:07.111 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:07.111 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:08.004 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:09.006 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:10.008 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:11.009 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:11.111 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:11.112 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:11.113 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:11.113 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:12.011 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:13.013 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:14.014 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:15.017 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:15.112 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:15.113 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:15.113 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:15.113 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:15.113 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:15.113 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:15.114 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:15.114 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:15.114 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:15.114 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:15.114 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:15.114 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:15.114 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:15.114 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:16.018 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:17.020 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:18.021 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:19.022 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:19.114 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:19.115 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:19.115 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:19.115 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:19.115 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:19.115 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:19.115 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:19.116 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:19.116 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:19.116 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:19.116 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:19.116 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:19.116 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:19.116 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:20.024 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:21.025 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:22.026 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:23.027 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:23.115 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:23.116 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:23.116 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:23.117 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:24.029 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:25.030 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:26.032 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:27.034 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:27.117 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:27.118 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:27.118 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:27.119 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:28.036 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:29.037 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:30.038 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:31.040 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:31.119 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:31.120 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:31.121 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:32.042 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:33.043 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:34.045 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:35.046 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:35.122 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:35.122 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:35.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:36.048 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:37.049 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:38.050 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:39.052 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:39.123 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:39.124 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:39.124 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:39.124 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:39.124 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:39.124 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:39.124 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:39.124 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:39.125 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:39.125 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:39.125 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:39.125 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:39.125 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:39.125 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:40.054 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:41.056 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:42.057 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:43.059 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:43.125 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:43.125 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:43.126 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:43.127 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:43.127 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:44.060 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:45.062 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:46.063 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:47.064 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:47.126 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:47.127 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:47.127 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:47.127 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:47.127 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:47.127 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:47.127 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:47.128 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:47.128 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:47.128 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:47.128 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:47.128 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:47.128 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:47.128 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:48.065 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:49.067 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:50.068 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:51.070 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:51.127 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:51.128 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:51.128 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:51.128 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:51.128 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:51.129 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:51.129 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:51.129 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:51.129 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:51.129 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:51.129 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:51.129 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:51.129 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:51.129 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:52.071 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:53.073 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:54.075 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:55.076 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:55.128 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:55.131 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:55.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:56.077 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:57.078 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:58.079 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:59.079 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:39:59.132 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:39:59.133 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:39:59.133 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:39:59.133 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:59.133 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:39:59.133 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:39:59.133 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:39:59.134 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:39:59.134 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:59.134 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:39:59.134 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:59.134 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:59.134 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:39:59.134 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:39:59.804 7fb2d46019a0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-juju-k8s-1454-1'], 'oper': 'UPDATE', 'request-id': 'req-10dc3d7c-4558-47f2-a814-0dc448db550a', 'type': 'virtual_router', 'uuid': 'a8ce144b-9496-4f0b-95ce-544a9934d80f'} 09/01/2025 01:40:00.081 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:01.082 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:02.083 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:03.084 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:03.134 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:03.135 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:03.135 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:03.135 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:03.135 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:03.135 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:03.135 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:03.136 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:03.136 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:03.136 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:03.136 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:03.136 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:03.136 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:03.136 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:04.085 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:05.087 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:06.088 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:07.090 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:07.135 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:07.136 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:07.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:08.092 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:09.092 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:10.094 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:11.096 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:11.137 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:11.138 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:11.139 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:11.139 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:11.139 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:11.139 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:11.139 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:11.139 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:11.139 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:11.140 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:11.140 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:11.140 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:11.140 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:11.140 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:12.096 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:13.097 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:14.099 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:15.101 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:15.139 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:15.141 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:15.141 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:15.141 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:15.141 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:15.141 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:15.141 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:15.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:15.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:15.142 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:15.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:15.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:15.142 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:15.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:16.102 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:17.103 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:18.105 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:19.106 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:19.141 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:19.142 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:19.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:19.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:19.142 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:19.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:19.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:19.143 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:19.143 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:19.143 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:19.143 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:19.143 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:19.143 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:19.143 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:20.107 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:21.108 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:22.109 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:23.111 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:23.142 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:23.144 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:23.145 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:23.145 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:24.112 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:25.114 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:26.114 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:27.115 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:27.145 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:27.146 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:27.146 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:27.146 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:27.146 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:27.146 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:27.146 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:27.146 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:27.147 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:27.147 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:27.147 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:27.147 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:27.147 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:27.147 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:28.117 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:29.119 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:30.120 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:31.121 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:31.147 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:31.148 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:31.149 7fb2d4ff15e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:31.149 7fb2d4ff15e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:32.123 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:33.124 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:34.125 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:35.127 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:35.148 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:35.149 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:35.149 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:35.149 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:35.149 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:35.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:35.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:35.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:35.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:35.150 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:35.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:35.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:35.150 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:35.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:36.128 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:37.129 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:38.130 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:39.132 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:39.149 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:39.150 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:39.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:39.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:39.151 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:40.133 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:41.135 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:42.136 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:43.137 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:43.150 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:43.151 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:43.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:44.138 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:45.140 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:46.141 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:47.143 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:47.152 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:47.153 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:47.153 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:47.153 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:47.153 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:47.153 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:47.153 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:47.154 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:47.154 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:47.154 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:47.154 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:47.154 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:47.154 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:47.154 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:48.144 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:49.145 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:49.936 7fb2d4ff1860 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:40:50.146 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:51.147 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:51.154 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:51.155 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:51.155 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:51.155 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:51.155 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:51.155 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:51.155 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:51.155 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:51.155 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:51.156 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:51.156 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:51.156 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:51.156 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:51.156 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:52.149 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:53.150 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:54.152 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:55.154 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:55.155 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:55.156 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:55.156 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:55.156 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:55.157 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:56.155 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:57.156 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:58.157 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:59.158 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:40:59.158 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:59.159 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:40:59.160 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:40:59.160 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:00.159 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:01.161 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:02.162 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:03.160 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:03.161 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:03.161 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:03.161 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:03.161 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:03.161 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:03.161 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:03.162 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:03.162 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:03.162 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:03.162 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:03.162 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:03.162 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:03.162 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:03.163 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:04.165 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:05.166 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:06.167 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:07.162 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:07.163 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:07.163 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:07.164 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:07.168 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:08.169 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:09.170 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:10.171 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:11.165 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:11.167 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:11.168 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:11.168 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:11.168 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:11.172 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:12.173 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:13.174 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:14.175 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:15.168 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:15.169 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:15.169 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:15.169 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:15.169 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:15.169 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:15.169 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:15.169 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:15.169 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:15.170 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:15.170 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:15.170 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:15.170 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:15.170 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:15.176 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:16.178 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:17.179 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:18.181 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:19.170 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:19.171 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:19.171 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:19.171 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:19.171 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:19.172 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:19.172 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:19.172 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:19.172 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:19.172 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:19.172 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:19.172 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:19.172 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:19.172 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:19.182 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:20.183 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:21.184 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:22.185 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:23.173 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:23.174 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:23.174 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:23.174 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:23.174 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:23.174 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:23.174 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:23.175 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:23.175 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:23.175 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:23.175 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:23.175 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:23.175 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:23.175 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:23.186 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:24.188 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:25.189 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:26.189 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:27.175 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:27.176 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:27.176 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:27.176 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:27.176 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:27.177 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:27.177 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:27.177 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:27.177 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:27.177 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:27.177 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:27.177 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:27.177 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:27.177 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:27.190 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:28.192 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:29.193 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:30.194 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:31.178 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:31.179 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:31.179 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:31.179 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:31.179 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:31.179 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:31.179 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:31.179 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:31.179 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:31.180 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:31.180 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:31.180 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:31.180 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:31.180 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:31.195 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:32.196 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:33.198 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:34.199 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:35.180 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:35.181 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:35.181 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:35.181 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:35.181 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:35.181 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:35.181 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:35.182 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:35.182 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:35.182 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:35.182 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:35.182 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:35.182 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:35.182 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:35.200 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:36.202 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:37.204 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:38.205 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:39.182 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:39.183 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:39.183 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:39.183 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:39.183 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:39.183 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:39.183 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:39.184 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:39.184 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:39.184 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:39.184 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:39.184 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:39.184 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:39.184 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:39.206 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:40.208 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:41.209 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:42.211 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:43.184 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:43.185 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:43.186 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:43.186 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:43.212 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:44.213 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:45.214 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:46.216 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:47.186 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:47.187 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:47.188 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:47.189 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:47.217 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:48.218 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:49.220 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:50.220 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:51.189 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:51.190 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:51.190 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:51.190 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:51.190 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:51.190 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:51.190 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:51.191 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:51.191 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:51.191 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:51.191 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:51.191 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:51.191 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:51.191 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:51.221 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:52.223 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:53.225 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:54.226 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:55.192 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:55.193 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:55.193 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:55.194 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:55.194 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:55.194 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:55.194 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:55.194 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:55.194 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:55.194 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:55.194 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:55.194 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:55.195 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:55.195 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:55.228 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:56.229 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:57.230 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:58.232 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:41:59.194 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:41:59.195 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:41:59.195 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:41:59.196 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:41:59.233 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:00.233 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:01.235 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:02.237 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:03.196 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:03.197 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:03.197 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:03.197 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:03.197 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:03.197 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:03.198 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:03.198 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:03.198 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:03.198 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:03.198 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:03.198 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:03.198 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:03.198 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:03.237 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:04.238 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:05.240 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:06.241 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:07.198 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:07.199 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:07.199 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:07.200 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:07.242 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:08.243 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:09.245 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:10.246 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:11.201 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:11.202 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:11.202 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:11.202 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:11.202 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:11.202 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:11.202 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:11.202 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:11.202 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:11.203 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:11.203 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:11.203 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:11.203 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:11.203 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:11.248 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:12.249 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:13.250 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:14.251 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:15.203 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:15.204 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:15.204 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:15.204 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:15.204 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:15.204 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:15.204 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:15.204 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:15.204 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:15.205 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:15.205 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:15.205 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:15.205 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:15.205 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:15.252 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:16.253 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:17.254 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:18.256 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:19.205 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:19.206 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:19.206 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:19.206 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:19.206 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:19.206 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:19.206 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:19.207 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:19.207 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:19.207 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:19.207 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:19.207 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:19.207 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:19.207 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:19.257 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:20.258 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:21.260 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:22.261 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:23.207 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:23.208 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:23.208 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:23.208 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:23.209 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:23.263 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:24.264 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:25.265 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:26.266 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:27.209 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:27.210 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:27.210 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:27.210 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:27.210 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:27.210 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:27.210 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:27.211 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:27.211 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:27.211 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:27.211 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:27.211 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:27.211 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:27.211 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:27.267 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:28.269 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:29.269 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:30.270 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:31.212 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:31.213 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:31.213 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:31.213 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:31.213 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:31.213 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:31.213 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:31.214 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:31.214 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:31.214 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:31.214 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:31.214 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:31.214 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:31.214 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:31.271 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:31.750 7fb2d4ff1860 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:42:32.273 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:33.273 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:34.104 7fb2d4ff1860 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:42:34.275 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:35.214 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:35.215 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:35.215 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:35.215 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:35.215 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:35.215 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:35.216 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:35.216 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:35.216 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:35.216 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:35.216 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:35.216 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:35.216 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:35.216 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:35.310 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:36.312 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:37.313 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:37.708 7fb2d4ff1860 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:42:38.314 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:39.216 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:39.217 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:39.218 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:39.218 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:39.218 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:39.218 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:39.218 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:39.218 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:39.218 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:39.219 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:39.219 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:39.219 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:39.219 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:39.219 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:39.315 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:40.317 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:41.318 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:42.320 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:43.218 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:43.219 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:43.219 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:43.219 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:43.219 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:43.219 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:43.219 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:43.220 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:43.220 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:43.220 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:43.220 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:43.220 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:43.220 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:43.220 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:43.321 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:44.322 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:45.323 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:46.324 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:47.220 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:47.221 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:47.221 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:47.221 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:47.221 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:47.221 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:47.222 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:47.222 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:47.222 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:47.222 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:47.222 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:47.222 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:47.222 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:47.222 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:47.324 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:48.326 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:49.328 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:50.329 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:51.222 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:51.223 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:51.223 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:51.223 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:51.224 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:51.331 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:52.332 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:53.333 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:54.334 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:55.224 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:55.225 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:55.226 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:55.227 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:55.335 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:56.336 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:57.337 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:58.338 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:42:59.227 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:42:59.227 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:42:59.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:42:59.340 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:00.342 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:01.342 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:02.344 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:03.228 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:03.229 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:03.229 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:03.229 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:03.229 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:03.230 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:03.230 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:03.230 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:03.230 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:03.230 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:03.230 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:03.230 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:03.230 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:03.230 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:03.345 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:04.346 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:05.348 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:06.350 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:07.235 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:07.241 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:07.241 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:07.242 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:07.242 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:07.242 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:07.242 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:07.242 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:07.242 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:07.242 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:07.242 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:07.242 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:07.243 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:07.243 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:07.351 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:08.353 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:09.354 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:10.356 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:11.242 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:11.243 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:11.243 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:11.243 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:11.243 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:11.243 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:11.243 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:11.243 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:11.243 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:11.244 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:11.244 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:11.244 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:11.244 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:11.244 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:11.357 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:12.359 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:13.361 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:14.363 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:15.243 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:15.244 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:15.244 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:15.245 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:15.364 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:16.365 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:17.366 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:18.368 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:19.246 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:19.247 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:19.248 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:19.248 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:19.369 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:20.370 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:21.372 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:22.373 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:23.248 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:23.249 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:23.249 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:23.249 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:23.249 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:23.249 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:23.249 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:23.249 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:23.250 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:23.250 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:23.250 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:23.250 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:23.250 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:23.250 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:23.374 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:24.376 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:25.377 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:26.378 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:27.250 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:27.251 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:27.251 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:27.251 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:27.251 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:27.251 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:27.251 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:27.252 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:27.252 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:27.252 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:27.252 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:27.252 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:27.252 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:27.252 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:27.380 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:28.381 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:29.383 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:30.384 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:31.252 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:31.253 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:31.253 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:31.254 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:31.386 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:32.387 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:33.389 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:34.391 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:35.255 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:35.256 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:35.256 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:35.256 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:35.256 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:35.256 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:35.256 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:35.256 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:35.256 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:35.256 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:35.257 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:35.257 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:35.257 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:35.257 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:35.392 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:36.394 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:37.395 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:38.397 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:39.256 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:39.257 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:39.257 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:39.257 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:39.257 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:39.257 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:39.257 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:39.258 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:39.258 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:39.258 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:39.258 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:39.258 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:39.258 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:39.258 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:39.397 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:40.398 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:41.400 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:42.402 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:43.258 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:43.259 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:43.259 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:43.259 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:43.260 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:43.403 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:44.404 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:45.406 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:46.407 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:47.260 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:47.261 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:47.261 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:47.261 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:47.262 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:47.409 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:48.411 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:49.411 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:50.413 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:51.262 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:51.263 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:51.263 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:51.263 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:51.263 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:51.263 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:51.263 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:51.264 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:51.264 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:51.264 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:51.264 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:51.264 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:51.264 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:51.264 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:51.414 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:52.415 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:53.417 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:54.418 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:55.264 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:55.266 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:55.267 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:55.267 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:55.267 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:55.420 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:56.421 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:57.421 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:58.422 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:43:59.267 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:59.268 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:59.269 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:43:59.269 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:43:59.423 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:00.425 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:01.426 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:02.428 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:03.268 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:03.269 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:03.270 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:03.271 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:03.271 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:03.429 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:04.430 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:05.432 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:06.466 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:07.270 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:07.271 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:07.272 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:07.273 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:07.468 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:08.470 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:09.471 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:10.472 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:11.273 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:11.274 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:11.274 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:11.274 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:11.274 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:11.274 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:11.274 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:11.274 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:11.275 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:11.275 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:11.275 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:11.275 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:11.275 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:11.275 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:11.473 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:12.475 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:13.476 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:14.478 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:15.275 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:15.276 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:15.276 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:15.276 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:15.276 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:15.276 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:15.276 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:15.276 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:15.276 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:15.276 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:15.277 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:15.277 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:15.277 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:15.277 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:15.479 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:16.480 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:17.482 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:18.483 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:19.277 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:19.279 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:19.279 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:19.279 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:19.279 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:19.279 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:19.279 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:19.280 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:19.280 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:19.280 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:19.280 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:19.280 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:19.280 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:19.280 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:19.484 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:20.493 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:21.498 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:22.500 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:23.279 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:23.280 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:23.280 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:23.281 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:23.501 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:24.502 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:25.503 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:26.505 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:27.281 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:27.282 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:27.282 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:27.283 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:27.506 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:28.507 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:29.509 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:30.510 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:31.283 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:31.284 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:31.285 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:31.511 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:32.512 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:33.514 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:34.516 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:35.286 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:35.287 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:35.287 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:35.287 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:35.287 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:35.287 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:35.287 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:35.287 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:35.288 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:35.288 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:35.288 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:35.288 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:35.288 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:35.288 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:35.517 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:36.518 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:37.519 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:38.521 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:39.287 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:39.289 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:39.289 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:39.289 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:39.289 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:39.289 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:39.289 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:39.290 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:39.290 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:39.290 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:39.290 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:39.290 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:39.290 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:39.290 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:39.523 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:40.524 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:41.525 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:42.527 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:43.290 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:43.291 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:43.292 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:43.292 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:43.528 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:44.529 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:45.531 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:46.532 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:47.292 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:47.293 7fb2d4ff1860 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:47.293 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:47.293 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:47.293 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:47.293 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:47.293 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:47.294 7fb2d4ff1860 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:47.294 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:47.294 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:47.294 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:47.294 7fb2d4ff1860 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:47.294 7fb2d4ff1860 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:47.294 7fb2d4ff1860 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:47.532 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:48.534 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:49.536 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:50.538 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:51.294 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:51.295 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:51.295 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:51.295 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:51.295 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:51.295 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:51.295 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:51.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:51.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:51.296 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:51.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:51.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:51.296 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:51.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:51.540 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:52.541 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:53.542 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:54.544 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:55.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:55.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:55.298 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:55.298 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:55.298 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:55.545 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:56.546 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:57.548 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:58.550 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:44:59.298 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:44:59.299 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:44:59.299 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:44:59.299 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:59.299 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:44:59.300 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:44:59.300 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:44:59.300 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:44:59.300 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:59.300 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:44:59.300 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:59.300 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:59.300 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:44:59.300 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:44:59.551 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:00.552 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:01.554 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:02.555 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:03.300 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:03.301 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:03.301 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:03.301 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:03.301 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:03.301 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:03.301 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:03.302 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:03.302 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:03.302 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:03.302 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:03.302 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:03.302 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:03.302 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:03.556 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:04.557 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:05.558 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:06.606 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:07.302 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:07.303 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:07.303 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:07.303 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:07.303 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:07.303 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:07.304 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:07.304 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:07.304 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:07.304 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:07.304 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:07.304 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:07.304 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:07.304 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:07.607 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:08.609 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:09.611 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:10.611 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:11.304 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:11.305 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:11.305 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:11.306 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:11.306 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:11.306 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:11.306 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:11.306 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:11.307 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:11.307 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:11.307 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:11.307 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:11.307 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:11.307 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:11.613 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:12.614 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:13.616 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:14.617 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:15.307 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:15.308 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:15.309 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:15.309 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:15.618 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:16.620 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:17.621 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:18.623 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:19.309 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:19.310 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:19.310 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:19.310 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:19.310 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:19.310 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:19.310 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:19.311 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:19.311 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:19.311 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:19.311 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:19.311 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:19.311 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:19.311 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:19.624 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:20.625 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:21.627 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:22.628 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:23.312 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:23.313 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:23.313 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:23.313 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:23.313 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:23.313 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:23.313 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:23.314 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:23.314 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:23.314 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:23.314 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:23.314 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:23.314 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:23.314 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:23.629 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:24.631 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:25.632 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:26.634 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:27.314 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:27.315 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:27.315 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:27.315 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:27.315 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:27.315 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:27.316 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:27.316 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:27.316 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:27.316 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:27.316 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:27.316 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:27.316 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:27.316 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:27.635 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:28.636 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:29.638 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:30.640 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:31.317 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:31.318 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:31.318 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:31.318 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:31.318 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:31.318 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:31.318 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:31.319 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:31.319 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:31.319 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:31.319 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:31.319 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:31.319 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:31.319 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:31.641 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:32.642 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:33.644 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:34.645 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:35.319 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:35.320 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:35.320 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:35.320 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:35.320 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:35.320 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:35.320 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:35.321 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:35.321 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:35.321 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:35.321 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:35.321 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:35.321 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:35.321 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:35.647 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:36.648 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:37.650 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:38.651 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:39.321 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:39.322 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:39.323 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:39.323 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:39.323 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:39.652 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:40.653 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:41.654 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:42.655 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:43.323 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:43.324 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:43.325 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:43.325 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:43.325 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:43.656 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:44.657 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:45.658 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:46.660 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:47.325 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:47.326 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:47.326 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:47.326 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:47.326 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:47.326 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:47.327 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:47.327 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:47.327 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:47.327 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:47.327 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:47.327 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:47.327 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:47.327 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:47.661 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:48.663 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:49.664 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:50.666 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:51.327 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:51.328 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:51.328 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:51.328 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:51.329 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:51.667 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:52.668 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:53.670 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:54.672 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:55.330 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:55.331 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:55.331 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:55.331 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:55.331 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:55.331 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:55.331 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:55.332 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:55.332 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:55.332 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:55.332 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:55.332 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:55.332 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:55.332 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:55.673 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:56.674 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:57.676 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:58.677 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:45:59.332 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:45:59.333 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:45:59.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:45:59.679 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:00.681 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:01.682 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:02.683 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:03.334 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:03.335 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:03.335 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:03.335 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:03.335 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:03.335 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:03.335 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:03.336 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:03.336 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:03.336 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:03.336 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:03.336 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:03.336 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:03.336 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:03.685 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:04.686 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:05.687 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:06.689 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:07.337 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:07.338 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:07.338 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:07.338 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:07.338 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:07.338 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:07.338 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:07.339 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:07.339 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:07.339 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:07.339 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:07.339 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:07.339 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:07.339 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:07.690 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:08.691 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:09.692 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:10.694 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:11.339 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:11.339 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:11.340 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:11.695 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:12.697 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:13.698 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:14.699 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:15.341 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:15.342 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:15.342 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:15.342 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:15.342 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:15.342 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:15.342 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:15.342 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:15.343 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:15.343 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:15.343 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:15.343 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:15.343 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:15.343 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:15.701 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:16.702 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:17.702 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:18.704 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:19.343 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:19.344 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:19.344 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:19.344 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:19.344 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:19.344 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:19.344 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:19.344 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:19.344 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:19.345 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:19.345 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:19.345 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:19.345 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:19.345 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:19.705 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:20.707 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:21.708 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:22.710 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:23.345 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:23.346 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:23.346 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:23.346 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:23.346 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:23.346 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:23.346 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:23.346 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:23.346 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:23.346 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:23.347 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:23.347 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:23.347 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:23.347 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:23.711 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:24.713 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:25.714 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:26.716 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:27.347 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:27.348 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:27.348 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:27.348 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:27.348 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:27.348 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:27.348 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:27.348 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:27.348 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:27.349 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:27.349 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:27.349 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:27.349 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:27.349 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:27.717 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:28.719 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:29.720 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:30.721 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:31.349 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:31.350 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:31.350 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:31.350 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:31.350 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:31.350 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:31.350 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:31.350 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:31.350 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:31.351 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:31.351 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:31.351 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:31.351 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:31.351 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:31.722 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:32.724 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:33.725 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:34.727 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:35.351 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:35.352 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:35.352 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:35.352 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:35.352 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:35.352 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:35.352 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:35.353 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:35.353 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:35.353 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:35.353 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:35.353 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:35.353 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:35.353 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:35.728 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:36.730 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:37.732 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:38.733 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:39.352 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:39.353 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:39.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:39.734 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:40.736 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:41.737 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:42.738 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:43.354 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:43.355 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:43.356 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:43.356 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:43.356 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:43.356 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:43.356 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:43.356 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:43.356 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:43.357 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:43.357 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:43.357 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:43.357 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:43.357 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:43.644 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:46:43.740 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:44.740 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:45.742 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:46.744 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:47.357 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:47.358 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:47.358 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:47.358 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:47.358 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:47.358 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:47.358 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:47.358 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:47.358 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:47.358 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:47.359 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:47.359 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:47.359 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:47.359 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:47.745 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:48.747 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:49.748 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:50.749 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:51.359 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:51.360 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:51.360 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:51.360 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:51.360 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:51.360 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:51.360 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:51.361 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:51.361 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:51.361 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:51.361 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:51.361 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:51.361 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:51.361 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:51.751 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:52.752 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:53.753 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:54.755 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:55.361 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:55.362 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:55.362 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:55.362 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:55.362 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:55.362 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:55.362 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:55.363 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:55.363 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:55.363 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:55.363 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:55.363 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:55.363 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:55.363 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:55.757 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:56.758 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:57.760 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:58.761 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:46:59.363 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:46:59.364 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:46:59.365 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:46:59.763 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:00.764 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:01.766 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:02.767 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:03.366 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:03.367 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:03.367 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:03.367 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:03.367 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:03.367 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:03.367 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:03.368 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:03.368 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:03.368 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:03.368 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:03.368 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:03.368 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:03.368 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:03.769 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:04.770 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:05.771 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:06.773 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:07.367 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:07.369 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:07.369 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:07.369 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:07.369 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:07.369 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:07.369 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:07.369 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:07.369 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:07.370 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:07.370 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:07.370 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:07.370 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:07.370 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:07.775 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:08.776 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:09.778 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:10.780 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:11.370 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:11.371 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:11.372 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:11.372 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:11.372 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:11.781 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:12.782 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:13.784 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:14.785 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:15.372 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:15.373 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:15.373 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:15.373 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:15.373 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:15.373 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:15.373 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:15.373 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:15.373 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:15.374 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:15.374 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:15.374 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:15.374 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:15.374 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:15.786 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:16.788 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:17.789 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:18.791 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:19.374 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:19.375 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:19.376 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:19.792 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:20.793 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:21.794 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:22.796 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:23.376 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:23.377 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:23.377 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:23.377 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:23.377 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:23.377 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:23.377 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:23.378 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:23.378 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:23.378 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:23.378 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:23.378 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:23.378 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:23.378 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:23.798 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:24.799 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:25.800 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:26.802 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:27.378 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:27.379 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:27.379 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:27.379 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:27.379 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:27.379 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:27.379 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:27.379 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:27.379 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:27.380 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:27.380 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:27.380 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:27.380 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:27.380 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:27.803 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:28.805 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:29.806 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:30.808 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:31.380 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:31.381 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:31.381 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:31.381 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:31.381 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:31.381 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:31.381 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:31.382 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:31.382 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:31.382 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:31.382 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:31.382 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:31.382 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:31.382 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:31.809 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:32.811 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:33.811 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:34.813 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:35.382 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:35.383 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:35.383 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:35.384 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:35.384 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:35.384 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:35.384 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:35.384 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:35.384 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:35.384 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:35.385 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:35.385 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:35.385 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:35.385 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:35.815 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:36.816 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:37.817 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:38.819 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:39.384 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:39.385 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:39.386 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:39.820 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:40.821 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:41.823 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:42.824 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:43.387 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:43.387 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:43.388 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:43.389 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:43.826 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:44.828 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:45.829 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:46.830 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:47.388 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:47.389 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:47.389 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:47.389 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:47.390 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:47.390 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:47.390 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:47.390 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:47.390 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:47.390 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:47.390 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:47.390 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:47.391 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:47.391 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:47.831 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:48.833 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:49.835 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:50.836 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:51.390 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:51.391 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:51.391 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:51.391 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:51.391 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:51.391 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:51.391 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:51.392 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:51.392 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:51.392 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:51.392 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:51.392 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:51.392 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:51.392 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:51.837 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:52.838 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:53.840 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:54.841 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:55.392 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:55.393 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:55.393 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:55.393 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:55.393 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:55.393 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:55.393 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:55.394 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:55.394 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:55.394 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:55.394 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:55.394 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:55.394 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:55.394 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:55.843 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:56.844 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:57.846 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:58.847 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:47:59.394 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:47:59.395 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:47:59.395 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:47:59.395 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:47:59.396 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:47:59.849 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:00.850 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:01.852 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:02.853 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:03.396 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:03.397 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:03.398 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:03.398 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:03.398 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:03.398 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:03.398 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:03.398 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:03.398 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:03.399 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:03.399 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:03.399 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:03.399 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:03.399 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:03.854 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:04.856 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:05.857 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:06.858 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:07.398 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:07.399 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:07.399 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:07.399 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:07.399 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:07.400 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:07.400 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:07.400 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:07.400 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:07.400 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:07.400 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:07.400 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:07.400 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:07.400 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:07.860 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:08.861 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:09.862 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:10.669 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:48:10.864 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:11.401 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:11.402 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:11.403 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:11.403 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:11.403 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:11.403 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:11.403 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:11.403 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:11.403 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:11.403 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:11.404 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:11.404 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:11.404 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:11.404 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:11.910 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:12.912 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:13.452 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:48:13.914 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:14.915 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:15.403 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:15.404 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:15.405 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:15.406 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:15.406 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:15.916 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:16.918 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:17.011 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:48:17.919 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:18.921 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:19.406 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:19.407 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:19.407 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:19.407 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:19.407 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:19.407 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:19.407 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:19.408 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:19.408 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:19.408 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:19.408 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:19.408 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:19.408 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:19.408 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:19.923 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:20.925 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:21.926 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:22.928 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:23.408 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:23.409 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:23.410 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:23.929 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:24.930 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:25.932 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:26.933 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:27.409 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:27.411 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:27.411 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:27.411 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:27.411 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:27.411 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:27.411 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:27.411 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:27.411 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:27.412 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:27.412 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:27.412 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:27.412 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:27.412 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:27.934 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:28.936 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:29.937 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:30.938 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:31.411 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:31.412 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:31.412 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:31.412 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:31.413 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:31.940 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:32.941 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:33.943 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:34.943 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:35.413 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:35.414 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:35.414 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:35.414 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:35.415 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:35.945 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:36.946 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:37.948 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:38.949 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:39.415 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:39.416 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:39.416 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:39.416 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:39.416 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:39.416 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:39.416 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:39.417 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:39.417 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:39.417 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:39.417 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:39.417 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:39.417 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:39.417 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:39.950 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:40.952 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:41.953 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:42.954 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:43.417 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:43.418 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:43.419 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:43.956 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:44.957 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:45.959 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:46.961 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:47.419 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:47.420 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:47.421 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:47.421 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:47.963 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:48.965 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:49.966 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:50.967 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:51.420 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:51.421 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:51.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:51.968 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:52.970 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:53.971 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:54.973 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:55.422 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:55.423 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:55.424 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:55.425 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:55.425 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:55.974 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:56.976 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:57.977 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:58.979 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:48:59.424 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:48:59.425 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:59.426 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:59.427 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:48:59.427 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:48:59.980 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:00.982 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:01.984 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:02.985 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:03.426 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:03.428 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:03.428 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:03.428 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:03.428 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:03.428 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:03.428 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:03.428 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:03.428 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:03.429 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:03.429 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:03.429 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:03.429 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:03.429 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:03.986 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:04.988 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:05.989 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:06.990 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:07.428 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:07.429 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:07.430 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:07.430 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:07.430 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:07.430 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:07.430 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:07.430 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:07.430 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:07.430 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:07.431 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:07.431 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:07.431 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:07.431 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:07.992 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:08.993 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:09.995 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:10.996 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:11.430 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:11.431 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:11.431 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:11.431 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:11.432 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:11.997 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:12.999 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:14.001 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:15.002 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:15.432 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:15.433 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:15.433 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:15.433 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:15.434 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:16.004 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:17.006 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:18.007 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:19.009 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:19.434 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:19.435 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:19.435 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:19.435 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:19.435 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:19.435 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:19.435 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:19.436 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:19.436 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:19.436 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:19.436 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:19.436 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:19.436 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:19.436 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:20.010 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:21.011 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:22.013 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:23.014 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:23.436 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:23.437 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:23.437 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:23.437 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:23.437 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:23.438 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:23.438 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:23.438 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:23.438 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:23.438 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:23.438 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:23.438 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:23.438 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:23.438 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:24.016 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:25.017 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:26.018 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:27.018 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:27.439 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:27.440 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:27.441 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:27.441 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:27.441 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:28.020 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:29.021 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:30.023 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:31.023 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:31.440 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:31.441 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:31.441 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:31.442 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:31.442 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:31.442 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:31.442 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:31.442 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:31.442 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:31.442 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:31.442 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:31.443 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:31.443 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:31.443 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:32.025 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:33.025 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:34.026 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:35.028 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:35.443 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:35.444 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:35.444 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:35.444 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:35.444 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:35.444 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:35.445 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:35.445 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:35.445 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:35.445 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:35.445 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:35.445 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:35.445 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:35.445 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:36.029 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:37.030 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:38.031 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:39.032 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:39.445 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:39.446 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:39.446 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:39.446 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:39.446 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:39.446 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:39.446 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:39.447 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:39.447 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:39.447 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:39.447 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:39.447 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:39.447 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:39.447 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:40.034 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:41.035 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:42.036 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:43.038 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:43.447 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:43.448 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:43.449 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:43.449 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:43.449 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:44.039 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:45.040 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:46.042 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:47.043 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:47.449 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:47.451 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:47.452 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:47.452 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:48.044 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:49.045 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:50.047 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:51.048 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:51.451 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:51.452 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:51.452 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:51.452 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:51.452 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:51.452 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:51.452 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:51.452 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:51.453 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:51.453 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:51.453 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:51.453 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:51.453 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:51.453 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:52.050 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:53.050 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:54.051 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:55.052 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:55.453 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:55.454 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:55.454 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:55.455 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:56.054 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:57.055 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:58.056 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:59.057 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:49:59.455 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:49:59.456 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:49:59.457 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:49:59.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:00.059 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:01.060 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:02.061 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:03.062 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:03.457 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:03.458 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:03.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:03.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:03.458 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:03.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:03.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:03.459 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:03.459 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:03.459 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:03.459 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:03.459 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:03.459 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:03.459 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:04.062 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:05.064 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:06.065 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:07.066 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:07.458 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:07.459 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:07.459 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:07.460 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:08.068 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:09.069 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:10.070 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:11.072 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:11.461 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:11.462 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:11.462 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:11.462 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:11.462 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:11.462 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:11.462 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:11.463 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:11.463 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:11.463 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:11.463 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:11.463 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:11.463 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:11.463 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:12.073 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:13.074 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:14.075 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:15.076 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:15.463 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:15.464 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:15.464 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:15.464 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:15.464 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:15.464 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:15.464 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:15.465 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:15.465 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:15.465 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:15.465 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:15.465 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:15.465 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:15.465 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:16.078 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:17.079 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:18.080 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:19.082 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:19.465 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:19.465 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:19.466 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:20.083 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:21.085 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:22.086 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:23.088 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:23.467 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:23.468 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:23.468 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:23.468 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:23.468 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:23.468 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:23.468 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:23.469 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:23.469 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:23.469 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:23.469 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:23.469 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:23.469 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:23.469 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:24.089 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:25.090 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:26.090 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:27.091 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:27.469 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:27.470 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:27.470 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:27.470 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:27.471 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:28.092 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:29.094 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:30.095 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:31.096 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:31.471 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:31.473 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:31.473 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:31.473 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:31.473 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:31.473 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:31.473 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:31.473 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:31.473 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:31.474 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:31.474 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:31.474 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:31.474 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:31.474 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:32.098 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:33.099 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:34.100 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:35.102 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:35.473 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:35.474 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:35.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:36.103 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:37.104 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:38.105 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:39.106 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:39.475 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:39.476 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:39.476 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:39.476 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:39.476 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:39.476 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:39.476 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:39.477 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:39.477 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:39.477 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:39.477 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:39.477 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:39.477 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:39.477 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:40.108 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:41.109 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:42.111 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:43.112 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:43.477 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:43.478 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:43.478 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:43.478 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:43.478 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:43.478 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:43.478 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:43.479 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:43.479 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:43.479 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:43.479 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:43.479 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:43.479 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:43.479 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:44.114 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:45.115 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:46.116 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:47.117 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:47.479 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:47.480 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:47.480 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:47.480 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:47.481 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:48.118 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:49.120 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:50.121 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:51.122 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:51.481 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:51.482 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:51.482 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:51.482 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:51.483 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:52.124 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:53.125 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:54.126 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:55.127 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:55.483 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:55.484 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:55.484 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:55.484 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:55.484 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:55.484 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:55.484 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:55.484 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:55.484 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:55.485 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:55.485 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:55.485 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:55.485 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:55.485 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:56.129 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:57.129 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:58.131 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:59.132 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:50:59.484 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:50:59.485 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:50:59.485 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:50:59.485 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:50:59.486 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:00.134 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:01.134 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:02.136 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:03.137 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:03.486 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:03.488 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:03.488 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:03.488 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:03.488 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:03.488 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:03.488 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:03.489 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:03.489 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:03.489 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:03.489 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:03.489 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:03.489 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:03.489 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:04.138 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:05.139 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:06.140 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:07.142 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:07.488 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:07.489 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:07.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:08.143 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:09.144 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:10.146 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:11.147 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:11.490 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:11.491 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:11.491 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:11.491 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:11.491 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:11.491 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:11.491 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:11.492 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:11.492 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:11.492 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:11.492 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:11.492 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:11.492 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:11.492 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:12.148 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:13.150 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:14.151 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:15.152 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:15.492 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:15.493 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:15.493 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:15.493 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:15.493 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:15.493 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:15.493 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:15.494 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:15.494 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:15.494 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:15.494 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:15.494 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:15.494 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:15.494 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:16.153 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:17.154 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:18.156 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:19.157 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:19.494 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:19.495 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:19.495 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:19.495 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:19.495 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:19.495 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:19.495 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:19.495 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:19.495 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:19.496 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:19.496 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:19.496 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:19.496 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:19.496 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:20.159 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:21.160 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:22.161 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:23.162 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:23.495 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:23.496 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:23.497 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:24.163 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:25.163 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:26.165 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:27.166 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:27.498 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:27.499 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:27.499 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:27.499 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:27.499 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:27.499 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:27.499 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:27.499 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:27.499 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:27.500 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:27.500 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:27.500 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:27.500 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:27.500 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:28.168 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:29.169 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:30.170 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:31.171 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:31.500 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:31.500 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:31.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:32.172 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:33.173 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:34.175 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:35.176 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:35.501 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:35.502 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:35.502 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:35.502 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:35.502 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:35.502 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:35.503 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:35.503 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:35.503 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:35.503 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:35.503 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:35.503 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:35.503 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:35.503 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:36.177 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:37.179 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:38.180 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:39.181 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:39.503 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:39.503 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:39.503 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:39.504 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:40.182 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:41.183 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:42.184 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:43.186 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:43.505 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:43.506 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:43.506 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:43.506 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:43.506 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:43.506 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:43.506 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:43.506 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:43.507 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:43.507 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:43.507 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:43.507 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:43.507 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:43.507 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:44.188 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:45.189 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:46.190 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:47.192 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:47.507 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:47.508 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:47.508 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:47.508 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:47.508 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:47.508 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:47.508 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:47.508 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:47.508 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:47.509 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:47.509 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:47.509 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:47.509 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:47.509 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:48.193 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:49.194 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:50.122 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:51:50.195 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:51.196 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:51.508 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:51.509 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:51.510 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:51.510 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:51.510 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:51.510 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:51.510 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:51.510 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:51.510 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:51.511 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:51.511 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:51.511 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:51.511 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:51.511 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:52.198 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:53.198 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:54.199 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:55.201 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:55.510 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:55.511 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:55.511 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:55.512 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:56.202 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:57.203 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:58.204 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:59.205 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:51:59.513 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:59.514 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:59.514 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:59.514 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:59.514 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:59.514 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:59.514 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:59.515 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:59.515 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:59.515 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:59.515 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:59.515 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:59.515 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:51:59.515 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:00.206 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:01.208 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:02.209 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:03.210 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:03.514 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:03.515 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:03.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:04.211 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:05.213 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:06.214 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:07.215 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:07.516 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:07.517 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:07.518 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:07.519 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:07.519 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:08.217 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:09.218 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:10.219 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:11.220 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:11.518 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:11.519 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:11.519 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:11.519 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:11.519 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:11.519 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:11.519 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:11.520 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:11.520 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:11.520 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:11.520 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:11.520 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:11.520 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:11.520 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:12.221 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:13.222 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:14.224 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:15.225 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:15.519 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:15.520 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:15.520 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:15.520 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:15.521 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:16.227 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:17.229 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:18.230 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:19.230 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:19.521 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:19.522 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:19.522 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:19.522 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:19.522 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:19.522 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:19.522 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:19.523 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:19.523 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:19.523 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:19.523 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:19.523 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:19.523 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:19.523 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:20.232 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:21.233 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:22.235 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:23.236 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:23.522 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:23.523 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:23.523 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:23.524 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:24.237 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:25.238 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:26.240 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:27.240 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:27.524 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:27.525 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:27.525 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:27.526 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:28.242 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:29.244 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:30.245 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:31.247 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:31.526 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:31.528 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:31.528 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:31.528 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:31.528 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:31.528 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:31.528 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:31.528 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:31.529 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:31.529 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:31.529 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:31.529 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:31.529 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:31.529 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:32.248 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:33.249 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:34.250 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:35.252 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:35.529 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:35.530 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:35.530 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:35.530 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:35.530 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:35.530 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:35.530 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:35.530 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:35.530 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:35.530 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:35.531 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:35.531 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:35.531 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:35.531 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:36.252 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:37.254 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:38.255 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:39.256 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:39.530 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:39.531 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:39.532 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:39.533 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:40.258 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:41.258 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:42.259 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:43.260 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:43.533 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:43.534 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:43.534 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:43.534 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:43.534 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:43.534 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:43.534 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:43.534 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:43.534 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:43.535 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:43.535 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:43.535 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:43.535 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:43.535 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:44.262 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:45.263 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:46.264 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:47.265 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:47.535 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:47.536 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:47.536 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:47.536 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:47.536 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:47.536 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:47.537 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:47.537 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:47.537 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:47.537 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:47.537 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:47.537 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:47.537 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:47.537 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:48.266 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:49.268 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:50.269 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:51.271 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:51.537 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:51.538 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:51.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:52.272 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:53.274 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:54.275 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:55.277 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:55.539 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:55.540 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:55.541 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:55.541 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:56.279 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:57.279 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:58.281 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:59.282 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:52:59.541 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:59.549 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:59.549 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:59.549 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:59.549 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:59.549 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:59.549 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:59.549 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:59.549 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:59.549 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:59.550 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:59.550 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:59.550 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:52:59.550 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:00.283 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:01.284 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:02.286 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:03.287 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:03.550 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:03.551 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:03.552 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:04.288 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:05.290 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:06.291 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:07.292 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:07.551 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:07.553 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:07.553 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:07.553 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:07.553 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:07.553 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:07.553 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:07.553 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:07.553 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:07.554 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:07.554 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:07.554 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:07.554 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:07.554 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:08.294 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:09.296 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:10.297 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:11.299 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:11.553 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:11.554 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:11.554 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:11.554 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:11.555 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:12.300 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:13.301 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:14.301 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:15.302 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:15.555 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:15.556 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:15.556 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:15.556 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:15.556 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:15.556 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:15.556 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:15.556 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:15.556 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:15.556 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:15.557 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:15.557 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:15.557 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:15.557 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:16.304 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:17.305 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:18.306 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:19.307 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:19.556 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:19.557 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:19.557 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:19.557 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:19.557 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:19.557 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:19.557 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:19.558 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:19.558 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:19.558 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:19.558 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:19.558 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:19.558 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:19.558 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:20.309 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:21.310 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:22.311 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:23.313 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:23.557 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:23.558 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:23.559 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:23.560 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:23.560 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:24.314 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:25.315 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:26.316 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:27.317 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:27.560 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:27.561 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:27.561 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:27.561 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:27.561 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:27.561 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:27.561 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:27.562 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:27.562 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:27.562 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:27.562 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:27.562 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:27.562 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:27.562 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:28.318 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:29.320 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:30.321 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:31.322 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:31.562 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:31.563 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:31.563 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:31.563 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:31.563 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:31.563 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:31.563 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:31.564 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:31.564 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:31.564 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:31.564 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:31.564 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:31.564 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:31.564 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:32.324 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:33.325 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:34.326 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:35.327 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:35.564 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:35.565 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:35.565 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:35.565 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:35.565 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:35.565 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:35.565 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:35.566 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:35.566 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:35.566 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:35.566 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:35.566 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:35.566 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:35.566 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:36.328 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:37.330 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:38.331 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:39.332 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:39.566 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:39.567 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:39.567 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:39.567 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:39.567 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:39.567 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:39.567 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:39.568 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:39.568 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:39.568 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:39.568 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:39.568 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:39.568 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:39.568 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:40.334 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:41.335 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:42.336 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:43.337 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:43.568 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:43.569 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:43.569 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:43.569 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:43.569 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:43.569 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:43.569 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:43.569 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:43.570 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:43.570 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:43.570 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:43.570 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:43.570 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:43.570 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:44.339 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:45.416 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:46.418 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:47.419 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:47.570 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:47.571 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:47.572 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:47.572 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:47.572 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:48.420 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:49.421 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:49.586 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:53:50.422 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:51.424 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:51.572 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:51.573 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:51.574 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:51.574 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:51.574 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:51.574 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:51.574 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:51.574 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:51.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:51.575 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:51.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:51.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:51.575 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:51.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:51.971 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:53:52.425 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:53.427 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:54.428 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:55.429 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:55.518 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:53:55.574 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:55.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:55.576 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:55.576 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:56.432 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:57.432 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:58.434 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:59.435 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:53:59.575 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:59.611 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:59.611 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:59.611 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:59.611 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:59.611 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:59.611 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:59.611 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:59.611 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:59.612 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:59.612 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:59.612 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:59.612 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:53:59.612 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:00.436 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:01.437 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:02.439 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:03.440 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:03.611 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:03.612 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:03.612 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:03.612 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:03.612 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:03.612 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:03.612 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:03.613 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:03.613 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:03.613 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:03.613 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:03.613 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:03.613 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:03.613 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:04.442 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:05.443 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:06.444 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:07.445 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:07.612 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:07.613 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:07.614 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:07.614 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:07.614 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:07.614 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:07.614 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:07.614 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:07.614 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:07.614 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:07.615 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:07.615 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:07.615 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:07.615 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:08.446 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:09.448 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:10.449 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:11.451 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:11.614 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:11.616 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:11.616 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:11.616 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:11.616 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:11.616 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:11.616 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:11.616 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:11.616 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:11.617 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:11.617 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:11.617 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:11.617 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:11.617 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:12.452 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:13.453 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:14.455 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:15.456 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:15.616 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:15.617 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:15.617 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:15.617 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:15.617 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:15.617 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:15.617 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:15.618 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:15.618 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:15.618 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:15.618 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:15.618 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:15.618 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:15.618 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:16.457 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:17.458 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:18.459 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:19.461 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:19.617 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:19.618 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:19.618 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:19.618 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:19.618 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:19.619 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:19.619 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:19.619 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:19.619 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:19.619 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:19.619 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:19.619 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:19.619 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:19.619 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:20.462 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:21.463 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:22.464 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:23.466 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:23.618 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:23.620 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:23.620 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:23.620 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:23.620 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:23.620 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:23.620 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:23.620 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:23.620 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:23.620 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:23.621 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:23.621 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:23.621 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:23.621 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:24.467 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:25.469 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:26.470 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:27.470 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:27.620 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:27.621 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:27.621 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:27.621 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:27.621 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:27.621 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:27.621 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:27.622 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:27.622 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:27.622 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:27.622 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:27.622 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:27.622 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:27.622 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:28.472 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:29.473 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:30.474 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:31.476 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:31.621 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:31.622 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:31.622 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:31.622 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:31.623 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:32.477 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:33.479 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:34.480 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:35.481 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:35.623 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:35.624 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:35.624 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:35.624 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:35.624 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:35.624 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:35.624 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:35.625 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:35.625 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:35.625 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:35.625 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:35.625 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:35.625 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:35.625 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:36.482 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:37.484 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:38.484 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:39.486 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:39.624 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:39.625 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:39.625 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:39.626 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:39.626 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:39.626 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:39.626 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:39.626 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:39.626 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:39.626 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:39.627 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:39.627 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:39.627 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:39.627 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:40.488 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:41.489 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:42.490 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:43.491 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:43.626 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:43.627 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:43.627 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:43.627 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:43.628 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:44.493 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:45.494 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:46.496 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:47.498 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:47.628 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:47.629 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:47.629 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:47.630 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:48.499 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:49.500 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:50.502 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:51.503 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:51.630 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:51.631 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:51.631 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:51.632 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:52.504 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:53.505 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:54.507 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:55.508 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:55.632 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:55.633 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:55.633 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:55.633 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:55.633 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:55.633 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:55.633 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:55.634 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:55.634 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:55.634 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:55.634 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:55.634 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:55.634 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:55.634 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:56.510 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:57.511 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:58.513 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:59.514 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:54:59.634 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:59.635 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:59.635 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:59.635 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:59.635 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:59.635 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:59.635 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:59.636 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:59.636 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:59.636 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:59.636 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:59.636 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:59.636 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:54:59.636 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:00.515 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:01.517 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:02.518 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:03.520 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:03.636 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:03.637 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:03.637 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:03.637 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:03.637 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:03.637 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:03.637 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:03.637 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:03.637 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:03.638 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:03.638 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:03.638 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:03.638 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:03.638 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:04.522 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:05.523 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:06.525 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:07.527 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:07.637 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:07.638 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:07.639 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:07.639 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:07.639 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:07.639 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:07.639 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:07.639 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:07.639 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:07.640 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:07.640 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:07.640 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:07.640 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:07.640 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:08.528 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:09.530 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:10.531 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:11.532 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:11.639 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:11.640 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:11.640 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:11.640 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:11.640 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:11.640 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:11.640 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:11.640 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:11.640 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:11.640 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:11.641 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:11.641 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:11.641 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:11.641 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:12.533 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:13.535 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:14.537 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:15.538 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:15.641 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:15.642 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:15.643 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:16.539 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:17.541 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:18.541 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:19.542 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:19.642 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:19.643 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:19.643 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:19.643 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:19.643 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:19.643 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:19.643 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:19.644 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:19.644 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:19.644 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:19.644 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:19.644 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:19.644 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:19.644 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:20.544 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:21.545 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:22.547 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:23.548 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:23.644 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:23.645 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:23.645 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:23.645 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:23.645 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:23.645 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:23.645 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:23.646 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:23.646 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:23.646 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:23.646 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:23.646 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:23.646 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:23.646 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:24.549 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:25.551 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:26.552 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:27.554 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:27.646 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:27.647 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:27.647 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:27.647 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:27.647 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:27.647 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:27.647 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:27.648 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:27.648 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:27.648 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:27.648 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:27.648 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:27.648 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:27.648 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:28.556 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:29.558 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:30.559 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:31.560 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:31.648 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:31.649 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:31.649 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:31.649 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:31.649 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:31.649 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:31.649 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:31.649 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:31.649 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:31.650 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:31.650 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:31.650 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:31.650 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:31.650 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:32.562 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:33.564 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:34.565 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:35.567 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:35.649 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:35.650 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:35.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:36.568 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:37.568 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:38.570 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:39.571 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:39.651 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:39.652 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:39.652 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:39.652 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:39.652 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:39.652 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:39.652 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:39.653 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:39.653 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:39.653 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:39.653 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:39.653 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:39.653 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:39.653 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:40.573 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:41.575 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:42.576 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:43.578 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:43.653 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:43.654 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:43.654 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:43.654 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:43.654 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:43.654 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:43.654 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:43.654 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:43.654 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:43.655 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:43.655 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:43.655 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:43.655 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:43.655 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:44.579 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:45.581 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:46.582 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:47.583 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:47.654 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:47.655 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:47.656 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:47.657 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:47.657 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:48.585 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:49.586 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:50.588 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:51.588 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:51.656 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:51.657 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:51.657 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:51.657 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:51.657 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:51.657 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:51.657 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:51.657 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:51.658 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:51.658 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:51.658 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:51.658 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:51.658 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:51.658 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:52.590 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:53.590 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:54.592 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:55.593 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:55.657 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:55.658 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:55.659 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:55.660 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:56.594 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:57.595 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:58.597 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:59.598 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:55:59.658 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:59.659 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:59.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:59.659 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:55:59.660 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:00.599 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:01.600 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:02.602 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:03.604 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:03.660 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:03.661 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:03.661 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:03.661 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:03.661 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:03.661 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:03.661 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:03.662 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:03.662 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:03.662 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:03.662 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:03.662 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:03.662 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:03.662 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:04.605 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:05.606 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:06.608 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:07.608 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:07.662 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:07.663 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:07.663 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:07.663 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:07.663 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:07.663 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:07.663 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:07.663 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:07.664 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:07.664 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:07.664 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:07.664 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:07.664 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:07.664 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.610 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:09.612 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:10.613 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:11.614 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:11.664 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:11.665 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:11.665 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:11.665 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:11.665 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:11.665 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:11.665 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:11.665 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:11.666 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:11.666 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:11.666 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:11.666 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:11.666 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:11.666 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:12.615 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:13.616 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:14.618 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:15.620 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:15.665 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:15.666 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:15.666 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:15.666 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:15.666 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:15.666 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:15.666 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:15.667 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:15.667 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:15.667 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:15.667 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:15.667 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:15.667 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:15.667 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:16.621 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:17.622 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:18.624 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:19.625 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:19.666 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:19.667 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:19.667 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:19.667 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:19.667 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:19.668 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:19.668 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:19.668 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:19.668 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:19.668 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:19.668 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:19.668 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:19.668 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:19.668 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.626 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:21.627 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:22.629 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:23.630 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:23.668 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:23.669 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:23.669 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:23.669 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:23.669 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:23.669 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:23.669 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:23.669 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:23.670 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:23.670 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:23.670 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:23.670 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:23.670 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:23.670 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:24.632 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:25.633 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:26.635 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:27.636 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:27.670 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:27.671 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:27.671 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:27.671 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:27.671 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:27.671 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:27.671 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:27.671 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:27.671 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:27.672 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:27.672 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:27.672 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:27.672 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:27.672 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:28.637 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:28.673 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:56:29.639 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:30.640 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:31.642 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:31.671 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:31.672 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:31.673 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:31.673 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:31.673 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:31.673 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:31.673 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:31.673 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:31.673 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:31.673 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:31.674 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:31.674 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:31.674 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:31.674 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:32.643 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:33.645 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:34.646 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:35.648 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:35.673 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:35.674 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:35.674 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:35.674 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:35.674 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:35.675 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:35.675 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:35.675 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:35.675 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:35.675 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:35.675 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:35.675 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:35.675 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:35.675 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:36.649 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:37.650 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:38.652 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:39.654 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:39.675 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:39.676 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:39.677 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:39.677 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:39.677 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:39.677 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:39.677 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:39.677 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:39.677 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:39.677 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:39.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:39.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:39.678 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:39.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:40.656 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:41.657 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:42.659 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:43.661 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:43.676 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:43.677 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:43.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:43.679 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:43.679 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:44.662 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:45.667 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:46.668 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:47.670 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:47.678 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:47.679 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:47.679 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:47.679 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:47.679 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:47.680 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:47.680 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:47.680 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:47.680 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:47.680 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:47.680 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:47.680 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:47.680 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:47.680 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:48.671 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:49.673 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:50.674 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:51.676 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:51.679 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:51.680 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:51.680 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:51.680 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:51.681 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:52.678 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:53.678 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:54.680 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:55.682 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:55.682 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:55.683 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:55.683 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:55.683 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:55.683 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:55.683 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:55.683 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:55.683 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:55.684 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:55.684 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:55.684 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:55.684 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:55.684 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:55.684 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:56.684 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:57.686 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:58.687 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:56:59.684 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:59.685 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:59.685 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:59.685 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:59.686 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:59.688 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:00.689 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:01.690 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:02.692 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:03.686 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:03.687 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:03.687 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:03.688 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:03.693 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:04.694 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:05.696 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:06.697 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:07.689 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:07.690 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:07.690 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:07.690 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:07.690 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:07.690 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:07.690 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:07.691 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:07.691 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:07.691 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:07.691 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:07.691 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:07.691 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:07.691 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:07.698 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:08.700 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:09.701 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:10.703 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:11.691 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:11.693 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:11.693 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:11.693 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:11.693 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:11.693 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:11.693 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:11.693 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:11.693 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:11.694 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:11.694 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:11.694 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:11.694 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:11.694 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:11.704 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:12.706 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:13.707 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:14.709 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:15.693 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:15.694 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:15.695 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:15.695 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:15.695 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:15.695 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:15.695 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:15.695 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:15.695 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:15.695 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:15.695 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:15.696 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:15.696 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:15.696 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:15.725 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:16.726 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:17.727 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:18.729 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:19.696 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:19.697 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:19.697 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:19.697 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:19.697 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:19.697 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:19.697 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:19.698 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:19.698 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:19.698 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:19.698 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:19.698 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:19.698 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:19.698 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:19.729 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:20.730 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:21.732 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:22.734 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:23.699 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:23.700 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:23.700 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:23.700 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:23.700 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:23.700 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:23.700 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:23.700 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:23.701 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:23.701 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:23.701 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:23.701 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:23.701 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:23.701 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:23.735 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:24.736 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:25.737 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:26.738 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:27.701 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:27.702 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:27.702 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:27.702 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:27.702 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:27.702 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:27.702 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:27.703 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:27.703 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:27.703 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:27.703 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:27.703 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:27.703 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:27.703 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:27.739 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:28.740 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:29.742 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:30.743 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:31.704 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:31.704 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:31.705 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:31.706 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:31.744 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:32.745 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:33.747 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:34.748 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:35.706 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:35.708 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:35.708 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:35.708 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:35.708 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:35.708 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:35.708 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:35.709 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:35.709 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:35.709 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:35.709 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:35.709 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:35.709 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:35.709 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:35.749 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:36.751 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:37.752 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:38.754 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:39.709 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:39.710 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:39.710 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:39.710 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:39.710 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:39.710 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:39.710 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:39.711 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:39.711 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:39.711 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:39.711 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:39.711 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:39.711 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:39.711 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:39.755 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:40.756 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:41.758 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:42.760 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:43.711 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:43.712 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:43.712 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:43.712 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:43.712 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:43.712 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:43.712 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:43.713 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:43.713 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:43.713 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:43.713 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:43.713 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:43.713 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:43.713 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:43.760 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:44.762 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:45.763 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:46.764 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:47.713 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:47.714 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:47.715 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:47.766 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:48.767 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:49.768 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:50.769 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:51.716 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:51.717 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:51.717 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:51.717 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:51.717 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:51.717 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:51.717 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:51.717 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:51.718 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:51.718 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:51.718 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:51.718 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:51.718 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:51.718 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:51.770 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:52.772 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:53.773 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:54.775 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:55.718 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:55.720 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:55.720 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:55.720 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:55.720 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:55.720 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:55.720 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:55.720 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:55.720 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:55.721 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:55.721 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:55.721 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:55.721 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:55.721 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:55.776 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:56.778 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:57.778 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:58.780 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:57:59.721 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:59.722 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:59.722 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:59.722 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:59.722 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:59.722 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:59.722 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:59.722 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:59.723 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:59.723 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:59.723 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:59.723 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:59.723 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:57:59.723 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:59.781 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:00.782 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:01.784 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:02.785 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:03.722 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:03.723 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:03.724 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:03.724 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:03.724 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:03.724 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:03.724 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:03.724 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:03.724 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:03.725 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:03.725 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:03.725 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:03.725 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:03.725 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:03.786 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:04.788 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:05.789 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:06.791 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:07.725 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:07.726 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:07.726 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:07.726 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:07.726 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:07.726 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:07.726 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:07.726 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:07.726 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:07.726 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:07.727 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:07.727 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:07.727 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:07.727 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:07.792 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:08.793 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:09.794 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:10.796 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:11.727 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:11.728 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:11.728 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:11.728 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:11.728 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:11.728 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:11.728 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:11.729 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:11.729 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:11.729 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:11.729 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:11.729 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:11.729 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:11.729 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:11.796 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:12.798 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:13.800 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:14.801 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:15.729 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:15.730 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:15.731 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:15.731 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:15.802 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:16.804 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:17.805 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:18.807 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:19.732 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:19.732 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:19.733 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:19.808 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:20.809 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:21.810 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:22.812 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:23.734 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:23.735 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:23.735 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:23.735 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:23.736 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:23.813 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:24.814 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:25.816 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:26.817 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:27.736 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:27.737 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:27.737 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:27.737 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:27.737 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:27.737 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:27.737 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:27.738 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:27.738 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:27.738 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:27.738 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:27.738 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:27.738 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:27.738 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:27.817 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:28.818 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:29.821 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:30.822 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:31.738 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:31.739 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:31.739 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:31.740 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:31.824 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:32.825 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:33.827 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:34.829 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:35.741 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:35.742 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:35.743 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:35.743 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:35.743 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:35.743 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:35.743 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:35.743 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:35.744 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:35.744 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:35.744 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:35.744 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:35.744 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:35.744 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:35.829 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:36.831 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:37.833 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:38.834 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:39.743 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:39.744 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:39.745 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:39.746 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:39.746 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:39.835 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:40.836 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:41.837 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:42.839 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:43.746 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:43.747 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:43.747 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:43.747 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:43.747 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:43.747 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:43.747 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:43.747 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:43.747 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:43.748 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:43.748 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:43.748 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:43.748 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:43.748 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:43.840 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:44.841 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:45.842 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:46.844 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:47.748 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:47.749 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:47.749 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:47.749 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:47.750 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:47.845 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:48.846 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:49.847 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:50.848 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:51.750 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:51.751 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:51.751 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:51.751 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:51.752 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:51.850 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:52.850 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:53.852 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:54.853 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:55.753 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:55.753 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:55.754 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:55.855 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:56.856 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:57.858 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:58.859 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:58:59.755 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:59.756 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:59.756 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:59.756 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:59.756 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:59.756 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:59.757 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:59.757 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:59.757 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:59.757 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:59.757 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:59.757 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:59.757 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:58:59.757 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:59.860 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:00.861 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:01.863 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:02.864 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:03.757 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:03.758 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:03.758 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:03.758 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:03.758 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:03.758 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:03.759 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:03.759 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:03.759 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.759 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:03.759 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.759 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.759 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:03.759 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.866 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:04.867 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:05.869 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:06.870 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:07.760 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:07.761 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:07.761 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:07.761 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:07.761 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:07.761 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:07.761 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:07.762 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:07.762 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:07.762 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:07.762 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:07.762 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:07.762 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:07.762 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:07.871 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:08.872 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:09.874 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:10.875 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:11.762 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:11.763 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:11.763 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:11.763 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:11.763 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:11.763 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:11.763 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:11.764 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:11.764 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:11.764 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:11.764 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:11.764 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:11.764 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:11.764 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:11.876 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:12.877 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:13.880 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:14.881 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:15.764 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:15.765 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:15.765 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:15.765 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:15.765 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:15.765 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:15.765 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:15.766 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:15.766 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:15.766 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:15.766 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:15.766 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:15.766 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:15.766 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:15.881 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:16.882 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:17.884 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:18.886 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:19.766 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:19.767 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:19.767 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:19.767 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:19.767 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:19.767 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:19.767 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:19.768 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:19.768 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:19.768 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:19.768 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:19.768 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:19.768 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:19.768 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:19.886 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:20.888 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:21.889 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:22.890 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:23.769 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:23.770 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:23.770 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:23.770 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:23.770 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:23.770 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:23.770 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:23.771 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:23.771 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:23.771 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:23.771 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:23.771 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:23.771 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:23.771 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:23.891 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:24.893 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:25.895 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:26.896 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:27.771 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:27.772 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:27.772 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:27.772 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:27.772 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:27.772 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:27.772 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:27.773 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:27.773 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:27.773 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:27.773 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:27.773 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:27.773 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:27.773 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:27.897 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:28.899 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:29.900 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:30.901 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:30.904 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:59:31.773 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:31.774 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:31.774 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:31.774 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:31.774 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:31.774 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:31.774 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:31.775 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:31.775 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:31.775 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:31.775 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:31.775 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:31.775 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:31.775 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:31.903 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:32.904 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:33.228 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:59:33.905 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:34.907 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:35.774 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:35.775 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:35.775 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:35.776 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:35.908 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:36.802 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:59:36.909 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:37.910 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:38.911 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:39.776 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:39.777 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:39.777 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:39.777 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:39.778 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:39.913 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:40.913 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:41.915 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:42.916 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:43.779 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:43.780 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:43.780 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:43.780 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:43.781 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:43.781 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:43.781 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:43.781 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:43.781 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:43.781 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:43.781 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:43.781 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:43.782 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:43.782 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:43.917 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:44.919 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:45.921 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:46.923 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:47.782 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:47.783 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:47.784 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:47.785 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:47.923 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:48.925 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:49.926 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:50.927 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:51.784 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:51.785 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:51.785 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:51.785 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:51.785 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:51.785 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:51.785 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:51.786 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:51.786 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:51.786 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:51.786 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:51.786 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:51.786 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:51.786 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:51.928 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:52.929 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:53.931 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:54.933 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:55.785 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:55.786 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:55.786 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:55.786 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:55.786 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:55.786 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:55.787 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:55.787 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:55.787 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:55.787 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:55.787 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:55.787 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:55.787 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:55.787 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:55.933 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:56.935 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:57.937 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:58.938 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 01:59:59.788 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:59.789 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:59.789 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:59.789 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:59.789 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:59.789 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:59.789 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:59.789 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:59.790 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:59.790 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:59.790 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:59.790 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:59.790 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:59:59.790 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:59.939 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:00.941 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:01.942 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:02.944 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:03.790 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:03.791 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:03.791 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:03.791 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:03.791 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:03.791 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:03.791 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:03.791 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:03.791 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:03.792 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:03.792 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:03.792 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:03.792 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:03.792 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:03.945 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:04.947 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:05.948 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:06.949 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:07.792 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:07.793 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:07.794 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:07.794 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:07.794 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:07.794 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:07.794 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:07.794 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:07.794 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:07.795 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:07.795 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:07.795 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:07.795 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:07.795 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:07.950 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:08.952 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:09.954 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:10.955 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:11.794 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:11.795 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:11.795 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:11.795 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:11.796 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:11.957 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:12.958 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:13.960 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:14.961 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:15.796 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:15.797 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:15.797 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:15.797 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:15.797 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:15.797 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:15.798 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:15.798 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:15.798 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:15.798 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:15.798 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:15.798 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:15.798 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:15.798 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:15.962 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:16.962 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:17.964 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:18.965 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:19.798 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:19.799 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:19.800 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:19.801 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:19.966 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:20.967 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:21.969 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:22.970 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:23.801 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:23.802 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:23.802 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:23.802 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:23.802 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:23.802 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:23.802 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:23.803 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:23.803 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:23.803 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:23.803 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:23.803 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:23.803 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:23.803 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:23.971 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:24.973 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:25.975 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:26.976 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:27.802 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:27.803 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:27.803 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:27.804 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:27.977 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:28.978 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:29.979 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:30.981 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:31.805 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:31.806 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:31.806 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:31.806 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:31.806 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:31.806 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:31.806 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:31.806 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:31.806 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:31.806 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:31.807 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:31.807 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:31.807 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:31.807 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:31.982 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:32.983 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:33.985 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:34.986 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:35.807 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:35.808 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:35.808 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:35.808 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:35.808 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:35.808 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:35.808 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:35.808 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:35.809 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:35.809 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:35.809 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:35.809 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:35.809 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:35.809 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:35.987 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:36.989 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:37.990 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:38.992 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:39.808 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:39.809 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:39.809 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:39.809 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:39.810 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:39.993 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:40.994 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:41.995 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:42.997 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:43.811 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:43.812 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:43.812 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:43.812 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:43.812 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:43.812 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:43.812 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:43.812 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:43.812 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:43.813 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:43.813 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:43.813 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:43.813 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:43.813 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:43.998 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:45.000 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:46.002 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:47.003 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:47.813 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:47.814 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:47.815 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:47.815 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:47.815 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:47.815 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:47.815 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:47.815 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:47.815 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:47.815 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:47.815 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:47.816 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:47.816 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:47.816 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:48.004 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:49.005 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:50.007 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:51.008 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:51.816 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:51.817 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:51.817 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:51.817 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:51.817 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:51.817 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:51.817 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:51.818 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:51.818 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:51.818 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:51.818 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:51.818 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:51.818 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:51.818 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:52.009 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:53.010 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:54.012 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:55.014 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:55.818 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:55.819 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:55.819 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:55.819 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:55.819 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:55.819 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:55.820 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:55.820 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:55.820 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:55.820 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:55.820 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:55.820 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:55.820 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:55.820 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:56.015 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:57.016 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:58.017 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:59.019 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:00:59.820 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:59.821 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:59.821 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:59.821 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:59.821 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:59.821 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:59.821 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:59.822 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:59.822 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:59.822 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:59.822 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:59.822 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:59.822 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:00:59.822 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:00.021 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:01.022 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:02.024 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:03.026 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:03.822 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:03.823 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:03.823 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:03.823 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:03.823 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:03.823 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:03.823 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:03.824 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:03.824 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:03.824 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:03.824 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:03.824 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:03.824 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:03.824 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:04.026 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:05.027 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:06.028 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:07.029 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:07.824 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:07.825 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:07.825 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:07.825 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:07.825 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:07.825 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:07.825 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:07.826 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:07.826 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:07.826 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:07.826 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:07.826 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:07.826 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:07.826 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:08.031 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:09.032 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:10.034 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:11.035 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:11.826 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:11.827 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:11.828 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:11.828 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:11.828 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:11.828 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:11.828 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:11.828 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:11.828 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:11.829 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:11.829 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:11.829 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:11.829 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:11.829 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:12.036 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:13.038 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:14.040 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:15.041 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:15.829 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:15.830 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:15.830 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:15.830 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:15.830 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:15.830 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:15.830 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:15.830 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:15.831 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:15.831 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:15.831 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:15.831 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:15.831 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:15.831 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:16.042 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:17.043 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:18.044 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:19.046 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:19.831 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:19.832 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:19.832 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:19.832 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:19.832 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:19.832 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:19.832 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:19.832 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:19.832 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:19.832 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:19.833 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:19.833 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:19.833 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:19.833 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:20.047 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:21.048 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:22.049 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:23.050 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:23.832 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:23.833 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:23.833 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:23.833 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:23.833 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:23.833 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:23.833 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:23.834 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:23.834 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:23.834 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:23.834 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:23.834 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:23.834 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:23.834 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:24.051 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:25.053 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:26.055 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:27.056 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:27.834 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:27.835 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:27.835 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:27.835 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:27.836 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:28.057 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:29.057 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:30.059 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:31.060 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:31.837 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:31.837 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:31.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:32.062 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:33.063 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:34.065 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:35.067 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:35.838 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:35.840 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:35.841 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:36.068 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:37.069 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:38.071 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:39.072 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:39.840 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:39.841 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:39.841 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:39.841 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:39.842 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:40.073 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:41.074 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:42.076 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:43.077 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:43.842 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:43.843 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:43.844 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:43.844 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:43.844 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:43.844 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:43.844 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:43.844 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:43.844 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:43.844 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:43.845 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:43.845 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:43.845 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:43.845 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:44.078 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:45.079 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:46.081 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:47.082 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:47.845 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:47.846 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:47.846 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:47.846 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:47.846 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:47.846 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:47.846 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:47.847 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:47.847 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:47.847 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:47.847 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:47.847 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:47.847 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:47.847 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:48.083 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:49.085 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:50.087 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:51.088 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:51.847 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:51.848 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:51.848 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:51.848 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:51.848 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:51.849 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:51.849 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:51.849 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:51.849 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:51.849 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:51.849 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:51.849 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:51.849 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:51.849 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:52.089 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:53.090 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:54.091 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:55.093 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:55.849 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:55.850 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:55.850 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:55.850 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:55.851 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:56.094 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:57.095 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:58.097 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:59.099 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:01:59.851 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:59.852 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:59.852 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:59.852 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:59.853 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:59.853 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:59.853 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:59.853 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:59.853 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:59.853 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:59.853 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:59.853 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:59.854 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:01:59.854 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:00.100 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:01.101 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:02.199 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:02.864 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:02:03.200 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:03.853 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:03.854 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:03.854 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:03.854 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:03.854 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:03.854 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:03.854 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:03.855 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:03.855 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:03.855 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:03.855 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:03.855 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:03.855 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:03.855 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:04.201 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:05.202 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:06.203 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:07.204 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:07.855 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:07.856 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:07.857 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:08.206 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:09.208 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:10.209 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:11.223 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:11.856 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:11.857 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:11.857 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:11.857 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:11.857 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:11.857 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:11.857 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:11.858 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:11.858 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:11.858 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:11.858 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:11.858 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:11.858 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:11.858 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:12.225 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:13.226 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:14.227 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:15.229 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:15.858 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:15.859 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:15.859 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:15.859 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:15.859 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:15.859 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:15.859 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:15.860 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:15.860 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:15.860 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:15.860 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:15.860 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:15.860 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:15.860 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:16.230 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:17.232 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:18.232 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:19.233 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:19.860 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:19.862 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:19.862 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:19.862 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:19.862 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:19.862 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:19.862 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:19.862 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:19.863 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:19.863 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:19.863 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:19.863 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:19.863 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:19.863 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:20.234 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:21.236 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:22.237 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:23.239 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:23.863 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:23.864 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:23.864 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:23.864 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:23.864 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:23.864 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:23.865 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:23.865 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:23.865 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:23.865 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:23.865 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:23.865 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:23.865 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:23.865 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:24.241 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:25.243 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:26.244 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:27.245 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:27.865 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:27.867 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:27.867 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:27.867 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:27.867 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:27.867 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:27.867 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:27.867 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:27.868 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:27.868 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:27.868 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:27.868 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:27.868 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:27.868 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:28.246 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:29.248 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:30.250 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:31.251 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:31.868 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:31.869 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:31.870 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:31.870 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:32.252 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:33.254 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:34.255 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:35.257 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:35.870 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:35.871 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:35.871 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:35.871 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:35.871 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:35.871 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:35.871 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:35.872 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:35.872 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:35.872 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:35.872 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:35.872 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:35.872 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:35.872 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:36.258 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:37.260 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:38.261 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:39.263 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:39.872 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:39.873 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:39.873 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:39.873 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:39.873 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:39.874 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:39.874 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:39.874 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:39.874 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:39.874 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:39.874 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:39.874 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:39.874 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:39.874 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:40.264 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:41.265 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:42.266 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:43.267 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:43.874 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:43.875 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:43.875 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:43.875 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:43.875 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:43.876 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:43.876 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:43.876 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:43.876 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:43.876 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:43.876 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:43.876 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:43.876 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:43.876 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:44.269 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:45.270 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:46.272 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:47.273 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:47.876 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:47.877 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:47.877 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:47.877 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:47.878 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:48.275 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:49.276 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:50.278 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:51.279 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:51.878 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:51.879 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:51.879 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:51.879 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:51.880 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:52.281 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:53.282 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:54.284 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:55.285 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:55.881 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:55.882 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:55.882 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:55.882 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:55.883 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:55.883 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:55.883 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:55.883 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:55.883 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:55.883 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:55.883 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:55.883 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:55.884 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:55.884 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:56.287 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:57.289 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:58.290 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:59.292 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:02:59.883 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:59.884 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:59.884 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:59.884 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:59.884 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:59.884 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:59.884 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:59.885 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:59.885 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:59.885 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:59.885 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:59.885 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:59.885 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:02:59.885 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:00.294 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:01.295 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:02.296 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:03.298 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:03.886 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:03.887 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:03.887 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:03.887 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:03.887 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:03.888 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:03.888 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:03.888 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:03.888 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:03.888 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:03.888 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:03.888 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:03.888 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:03.888 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:04.300 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:05.301 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:06.303 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:07.304 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:07.888 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:07.889 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:07.889 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:07.890 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:07.891 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:08.305 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:09.306 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:10.308 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:11.309 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:11.890 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:11.891 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:11.891 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:11.892 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:11.892 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:11.892 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:11.892 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:11.892 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:11.892 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:11.892 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:11.892 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:11.892 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:11.893 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:11.893 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:12.310 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:13.312 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:14.313 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:15.314 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:15.893 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:15.894 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:15.894 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:15.894 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:15.894 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:15.894 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:15.894 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:15.894 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:15.894 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:15.895 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:15.895 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:15.895 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:15.895 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:15.895 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:16.315 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:17.317 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:18.318 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:19.320 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:19.895 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:19.896 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:19.896 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:19.896 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:19.896 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:19.896 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:19.896 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:19.897 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:19.897 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:19.897 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:19.897 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:19.897 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:19.897 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:19.897 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:20.322 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:21.323 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:22.325 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:23.326 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:23.897 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:23.898 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:23.898 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:23.898 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:23.899 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:24.327 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:25.328 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:26.329 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:27.331 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:27.899 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:27.900 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:27.900 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:27.900 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:27.901 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:28.332 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:29.333 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:30.334 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:31.336 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:31.901 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:31.902 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:31.902 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:31.903 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:32.337 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:33.338 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:34.341 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:35.342 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:35.708 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:03:35.903 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:35.982 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:35.982 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:35.982 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:35.982 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:35.983 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:35.983 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:35.983 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:35.983 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:35.983 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:35.983 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:35.983 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:35.983 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:35.983 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:36.344 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:37.345 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:38.123 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:03:38.347 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:39.382 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:39.983 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:39.984 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:39.984 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:39.984 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:39.984 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:39.984 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:39.984 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:39.984 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:39.985 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:39.985 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:39.985 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:39.985 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:39.985 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:39.985 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:40.382 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:41.384 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:41.712 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:03:42.385 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:43.386 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:43.984 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:43.985 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:43.985 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:43.985 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:43.985 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:43.985 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:43.985 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:43.986 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:43.986 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:43.986 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:43.986 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:43.986 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:43.986 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:43.986 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:44.387 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:45.388 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:46.389 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:47.390 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:47.986 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:47.987 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:47.988 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:47.989 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:48.390 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:49.392 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:50.393 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:51.395 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:51.989 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:51.990 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:51.990 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:51.990 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:51.990 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:51.990 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:51.990 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:51.991 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:51.991 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:51.991 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:51.991 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:51.991 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:51.991 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:51.991 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:52.396 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:53.398 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:54.398 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:55.399 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:55.991 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:55.992 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:55.992 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:55.992 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:55.992 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:55.992 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:55.992 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:55.993 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:55.993 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:55.993 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:55.993 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:55.993 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:55.993 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:55.993 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:56.400 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:57.402 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:58.402 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:59.403 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:03:59.992 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:59.993 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:03:59.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:00.404 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:01.406 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:02.407 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:03.408 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:03.994 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:03.995 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:03.995 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:03.995 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:03.995 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:03.995 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:03.995 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:03.996 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:03.996 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:03.996 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:03.996 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:03.996 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:03.996 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:03.996 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:04.410 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:05.411 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:06.412 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:07.413 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:07.996 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:07.997 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:07.997 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:07.997 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:07.998 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:08.415 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:09.416 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:10.417 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:11.419 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:11.998 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:11.999 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:12.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:12.420 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:13.422 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:14.423 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:15.424 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:16.000 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:16.002 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:16.003 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:16.003 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:16.425 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:17.426 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:18.427 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:19.429 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:20.003 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:20.004 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:20.004 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:20.004 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:20.004 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:20.004 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:20.004 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:20.004 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:20.004 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:20.005 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:20.005 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:20.005 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:20.005 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:20.005 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:20.430 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:21.431 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:22.433 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:23.434 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:24.005 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:24.006 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:24.006 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:24.006 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:24.007 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:24.435 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:25.436 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:26.438 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:27.438 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:28.007 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:28.008 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:28.008 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:28.009 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:28.440 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:29.442 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:30.443 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:31.444 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:32.009 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:32.011 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:32.011 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:32.011 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:32.011 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:32.011 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:32.011 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:32.011 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:32.012 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.012 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:32.012 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.012 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.012 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:32.012 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.446 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:33.446 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:34.448 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:35.449 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:36.012 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:36.012 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:36.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:36.451 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:37.451 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:38.452 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:39.453 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:40.013 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:40.014 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:40.014 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:40.014 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:40.014 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:40.015 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:40.015 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:40.015 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:40.015 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:40.015 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:40.015 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:40.015 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:40.015 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:40.015 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:40.455 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:41.456 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:42.457 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:43.459 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:44.015 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:44.016 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:44.016 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:44.016 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:44.016 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:44.016 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:44.016 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:44.016 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:44.017 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:44.017 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:44.017 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:44.017 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:44.017 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:44.017 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:44.461 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:45.461 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:46.462 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:47.464 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:48.017 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:48.018 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:48.018 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:48.018 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:48.018 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:48.018 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:48.018 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:48.018 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:48.018 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:48.018 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:48.019 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:48.019 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:48.019 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:48.019 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:48.465 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:49.466 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:50.468 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:51.469 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:52.019 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:52.020 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:52.020 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:52.020 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:52.020 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:52.020 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:52.020 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:52.020 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:52.020 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:52.021 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:52.021 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:52.021 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:52.021 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:52.021 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:52.471 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:53.471 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:54.472 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:55.474 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:56.021 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:56.022 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:56.022 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:56.022 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:56.022 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:56.022 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:56.022 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:56.023 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:56.023 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.023 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:56.023 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.023 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.023 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:04:56.023 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.474 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:57.475 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:58.476 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:04:59.477 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:00.023 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:00.024 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:00.024 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:00.024 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:00.024 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:00.025 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:00.025 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:00.025 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:00.025 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:00.025 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:00.025 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:00.025 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:00.025 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:00.025 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:00.478 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:01.479 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:02.481 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:03.482 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:04.026 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:04.027 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:04.027 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:04.027 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:04.027 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:04.027 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:04.027 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:04.028 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:04.028 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:04.028 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:04.028 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:04.028 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:04.028 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:04.028 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:04.484 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:05.484 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:06.485 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:07.486 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:08.027 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:08.028 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:08.029 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:08.488 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:09.488 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:10.490 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:11.492 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:12.030 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:12.031 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:12.032 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:12.032 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:12.493 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:13.494 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:14.495 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:15.496 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:16.032 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:16.033 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:16.033 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:16.033 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:16.033 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:16.033 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:16.033 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:16.034 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:16.034 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:16.034 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:16.034 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:16.034 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:16.034 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:16.034 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:16.497 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:17.498 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:18.499 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:19.500 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:20.034 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:20.035 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:20.035 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:20.035 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:20.036 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:20.501 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:21.502 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:22.504 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:23.505 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:24.036 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:24.037 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:24.038 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:24.039 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:24.507 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:25.508 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:26.510 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:27.510 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:28.038 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:28.039 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:28.040 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:28.041 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:28.512 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:29.513 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:30.514 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:31.515 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:32.040 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:32.041 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:32.041 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:32.041 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:32.041 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:32.042 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:32.042 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:32.042 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:32.042 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:32.042 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:32.042 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:32.042 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:32.042 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:32.042 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:32.517 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:33.518 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:34.519 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:35.521 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:36.042 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:36.047 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:36.047 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:36.047 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:36.047 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:36.047 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:36.047 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:36.048 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:36.048 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:36.048 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:36.048 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:36.048 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:36.048 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:36.048 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:36.521 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:37.522 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:38.524 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:39.525 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:40.047 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:40.048 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:40.048 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:40.048 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:40.048 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:40.048 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:40.048 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:40.049 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:40.049 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:40.049 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:40.049 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:40.049 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:40.049 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:40.049 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:40.526 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:41.528 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:42.529 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:43.530 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:44.049 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:44.050 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:44.050 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:44.050 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:44.050 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:44.050 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:44.050 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:44.051 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:44.051 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:44.051 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:44.051 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:44.051 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:44.051 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:44.051 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:44.531 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:45.532 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:46.534 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:47.535 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:48.051 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:48.052 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:48.052 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:48.052 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:48.053 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:48.536 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:49.538 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:50.539 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:51.540 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:52.053 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:52.054 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:52.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:52.542 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:53.544 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:54.545 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:55.547 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:56.055 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:56.056 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:56.056 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:56.056 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:56.056 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:56.056 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:56.056 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:56.057 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:56.057 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:56.057 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:56.057 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:56.057 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:56.057 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:05:56.057 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:56.549 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:57.550 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:58.551 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:05:59.553 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:00.057 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:00.058 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:00.058 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:00.058 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:00.059 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:00.554 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:01.556 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:02.556 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:03.558 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:04.059 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:04.060 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:04.061 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:04.062 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:04.562 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:05.564 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:06.565 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:07.566 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:08.061 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:08.062 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:08.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:08.568 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:09.569 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:10.570 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:11.571 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:12.063 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:12.064 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:12.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:12.572 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:13.574 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:14.575 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:15.576 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:16.065 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:16.066 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:16.067 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:16.577 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:17.578 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:18.580 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:19.581 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:20.066 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:20.067 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:20.067 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:20.067 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:20.068 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:20.583 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:21.584 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:22.586 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:23.587 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:24.069 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:24.070 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:24.070 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:24.070 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:24.070 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:24.070 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:24.070 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:24.070 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:24.070 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:24.070 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:24.071 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:24.071 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:24.071 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:24.071 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:24.588 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:25.589 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:26.590 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:27.592 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:28.071 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:28.072 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:28.072 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:28.072 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:28.072 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:28.072 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:28.072 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:28.072 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:28.072 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:28.072 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:28.073 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:28.073 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:28.073 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:28.073 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:28.593 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:29.594 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:30.595 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:31.597 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:32.073 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:32.074 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:32.074 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:32.074 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:32.074 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:32.074 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:32.074 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:32.074 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:32.074 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:32.074 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:32.075 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:32.075 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:32.075 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:32.075 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:32.598 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:33.600 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:34.601 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:35.604 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:36.075 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:36.076 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:36.077 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:36.077 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:36.605 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:37.630 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:37.903 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:06:38.632 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:39.632 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:40.076 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:40.077 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:40.078 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:40.079 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:40.634 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:41.635 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:42.636 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:43.637 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:44.078 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:44.080 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:44.080 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:44.080 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:44.080 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:44.080 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:44.080 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:44.081 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:44.081 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:44.081 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:44.081 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:44.081 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:44.081 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:44.081 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:44.639 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:45.640 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:46.641 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:47.642 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:48.080 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:48.081 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:48.081 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:48.081 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:48.081 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:48.082 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:48.082 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:48.082 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:48.082 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:48.082 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:48.082 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:48.082 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:48.082 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:48.082 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:48.644 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:49.645 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:50.647 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:51.648 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:52.082 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:52.083 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:52.083 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:52.083 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:52.083 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:52.083 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:52.083 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:52.084 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:52.084 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:52.084 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:52.084 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:52.084 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:52.084 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:52.084 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:52.650 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:53.651 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:54.652 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:55.653 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:56.083 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:56.085 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:56.086 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:06:56.086 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:56.654 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:57.655 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:58.657 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:06:59.658 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:00.086 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:00.087 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:00.087 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:00.087 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:00.087 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:00.087 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:00.087 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:00.088 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:00.088 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:00.088 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:00.088 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:00.088 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:00.088 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:00.088 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:00.659 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:01.661 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:02.663 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:03.664 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:04.088 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:04.089 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:04.090 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:04.090 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:04.665 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:05.667 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:06.667 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:07.669 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:08.090 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:08.091 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:08.091 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:08.091 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:08.091 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:08.091 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:08.091 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:08.091 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:08.091 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:08.092 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:08.092 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:08.092 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:08.092 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:08.092 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:08.670 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:09.671 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:10.673 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:11.674 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:12.091 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:12.092 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:12.092 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:12.092 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:12.093 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:12.675 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:13.677 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:14.679 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:15.679 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:16.093 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:16.094 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:16.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:16.681 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:17.682 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:18.702 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:19.704 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:20.095 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:20.096 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:20.096 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:20.096 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:20.097 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:20.704 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:21.706 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:22.707 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:23.709 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:24.097 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:24.098 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:24.098 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:24.098 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:24.098 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:24.098 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:24.098 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:24.099 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:24.099 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:24.099 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:24.099 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:24.099 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:24.099 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:24.099 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:24.710 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:25.712 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:26.713 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:27.714 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:28.099 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:28.100 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:28.100 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:28.100 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:28.100 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:28.100 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:28.100 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:28.101 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:28.101 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:28.101 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:28.101 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:28.101 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:28.101 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:28.101 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:28.716 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:29.717 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:30.718 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:31.719 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:32.101 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:32.102 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:32.102 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:32.102 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:32.103 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:32.721 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:33.722 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:34.724 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:35.725 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:36.103 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:36.105 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:36.105 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:36.105 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:36.105 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:36.105 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:36.105 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:36.105 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:36.105 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:36.106 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:36.106 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:36.106 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:36.106 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:36.106 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:36.727 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:37.728 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:38.730 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:39.731 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:40.106 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:40.107 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:40.107 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:40.107 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:40.107 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:40.107 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:40.107 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:40.107 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:40.108 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:40.108 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:40.108 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:40.108 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:40.108 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:40.108 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:40.733 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:41.734 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:42.735 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:43.737 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:44.108 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:44.109 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:44.109 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:44.109 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:44.109 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:44.109 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:44.109 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:44.109 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:44.109 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:44.109 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:44.110 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:44.110 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:44.110 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:44.110 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:44.738 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:45.739 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:46.740 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:47.741 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:48.110 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:48.111 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:48.111 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:48.111 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:48.111 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:48.112 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:48.112 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:48.112 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:48.112 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:48.112 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:48.112 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:48.112 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:48.112 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:48.112 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:48.742 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:49.744 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:50.745 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:51.746 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:52.112 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:52.113 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:52.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:52.747 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:53.748 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:54.750 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:55.751 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:56.114 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:56.115 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:07:56.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:56.753 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:57.754 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:58.755 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:07:59.756 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:00.116 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:00.117 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:00.117 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:00.117 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:00.117 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:00.117 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:00.117 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:00.117 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:00.117 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:00.118 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:00.118 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:00.118 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:00.118 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:00.118 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:00.757 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:01.759 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:02.760 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:03.761 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:04.117 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:04.146 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:04.148 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:04.148 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:04.148 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:04.148 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:04.148 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:04.149 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:04.149 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:04.149 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:04.149 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:04.149 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:04.149 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:04.149 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:04.762 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:05.764 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:06.765 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:07.767 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:08.148 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:08.149 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:08.149 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:08.149 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:08.149 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:08.149 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:08.149 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:08.150 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:08.150 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:08.150 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:08.150 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:08.150 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:08.150 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:08.150 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:08.768 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:09.769 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:10.770 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:11.772 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:12.150 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:12.151 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:12.151 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:12.151 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:12.152 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:12.802 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:13.803 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:14.805 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:15.805 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:16.152 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:16.153 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:16.153 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:16.153 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:16.153 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:16.153 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:16.153 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:16.154 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:16.154 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:16.154 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:16.154 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:16.154 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:16.154 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:16.154 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:16.807 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:17.807 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:18.808 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:19.810 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:20.154 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:20.155 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:20.155 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:20.156 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:20.811 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:21.812 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:22.813 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:23.814 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:24.156 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:24.157 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:24.157 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:24.157 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:24.157 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:24.157 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:24.157 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:24.158 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:24.158 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:24.158 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:24.158 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:24.158 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:24.158 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:24.158 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:24.815 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:25.817 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:26.817 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:27.819 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:28.158 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:28.159 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:28.159 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:28.159 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:28.159 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:28.159 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:28.159 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:28.160 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:28.160 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:28.160 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:28.160 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:28.160 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:28.160 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:28.160 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:28.820 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:29.822 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:30.823 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:31.825 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:32.160 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:32.161 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:32.161 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:32.161 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:32.161 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:32.161 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:32.161 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:32.161 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:32.161 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:32.161 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:32.162 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:32.162 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:32.162 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:32.162 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:32.827 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:33.828 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:34.830 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:35.830 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:36.161 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:36.162 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:36.162 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:36.162 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:36.163 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:36.831 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:37.833 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:38.834 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:39.836 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:40.162 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:40.163 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:40.164 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:40.164 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:40.164 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:40.164 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:40.164 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:40.164 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:40.164 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:40.165 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:40.165 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:40.165 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:40.165 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:40.165 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:40.838 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:41.839 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:42.840 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:43.841 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:44.164 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:44.165 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:44.165 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:44.165 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:44.165 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:44.166 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:44.166 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:44.166 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:44.166 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:44.166 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:44.166 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:44.166 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:44.166 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:44.166 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:44.843 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:45.844 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:46.846 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:47.847 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:48.166 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:48.167 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:48.167 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:48.167 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:48.167 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:48.167 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:48.168 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:48.168 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:48.168 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:48.168 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:48.168 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:48.168 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:48.168 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:48.168 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:48.848 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:49.850 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:50.851 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:51.853 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:52.168 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:52.169 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:52.170 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:52.170 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:52.170 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:52.854 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:53.854 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:54.856 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:55.857 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:56.170 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:56.171 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:56.172 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:56.172 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:56.172 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:56.172 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:56.172 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:56.172 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:56.172 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:56.172 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:56.173 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:56.173 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:56.173 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:08:56.173 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:56.859 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:57.860 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:58.861 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:08:59.863 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:00.173 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:00.174 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:00.174 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:00.174 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:00.174 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:00.174 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:00.174 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:00.174 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:00.174 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:00.175 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:00.175 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:00.175 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:00.175 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:00.175 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:00.864 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:01.865 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:02.866 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:03.868 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:04.175 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:04.176 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:04.176 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:04.176 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:04.176 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:04.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:04.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:04.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:04.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:04.177 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:04.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:04.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:04.177 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:04.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:04.870 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:05.871 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:06.873 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:07.875 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:08.176 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:08.177 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:08.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:08.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:08.177 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:08.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:08.177 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:08.178 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:08.178 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:08.178 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:08.178 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:08.178 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:08.178 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:08.178 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:08.876 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:09.877 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:10.879 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:11.880 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:12.178 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:12.179 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:12.179 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:12.179 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:12.180 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:12.882 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:13.882 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:14.884 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:15.886 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:16.180 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:16.181 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:16.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:16.887 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:17.889 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:18.890 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:19.891 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:20.182 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:20.183 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:20.183 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:20.183 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:20.183 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:20.183 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:20.183 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:20.184 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:20.184 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:20.184 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:20.184 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:20.184 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:20.184 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:20.184 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:20.892 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:20.974 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:09:21.894 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:22.896 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:23.400 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:09:23.897 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:24.184 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:24.185 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:24.185 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:24.185 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:24.185 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:24.185 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:24.185 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:24.186 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:24.186 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:24.186 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:24.186 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:24.186 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:24.186 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:24.186 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:24.898 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:25.899 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:26.901 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:26.934 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:09:27.902 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:28.186 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:28.187 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:28.187 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:28.187 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:28.187 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:28.187 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:28.188 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:28.188 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:28.188 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:28.188 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:28.188 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:28.188 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:28.188 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:28.188 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:28.904 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:29.905 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:30.907 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:31.908 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:32.188 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:32.189 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:32.189 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:32.189 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:32.189 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:32.190 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:32.190 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:32.190 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:32.190 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:32.190 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:32.190 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:32.190 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:32.190 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:32.190 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:32.910 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:33.912 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:34.913 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:35.914 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:36.190 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:36.191 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:36.191 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:36.191 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:36.191 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:36.191 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:36.191 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:36.191 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:36.191 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:36.192 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:36.192 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:36.192 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:36.192 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:36.192 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:36.916 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:37.918 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:38.918 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:39.920 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:40.192 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:40.194 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:40.194 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:40.194 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:40.194 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:40.194 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:40.194 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:40.195 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:40.195 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:40.195 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:40.195 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:40.195 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:40.195 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:40.195 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:40.921 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:41.922 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:42.924 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:43.926 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:44.194 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:44.195 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:44.195 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:44.195 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:44.196 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:44.927 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:45.929 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:46.930 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:47.931 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:48.196 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:48.197 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:48.197 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:48.197 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:48.198 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:48.932 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:49.934 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:50.935 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:51.936 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:52.198 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:52.199 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:52.199 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:52.199 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:52.199 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:52.199 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:52.199 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:52.200 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:52.200 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:52.200 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:52.200 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:52.200 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:52.200 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:52.200 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:52.938 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:53.940 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:54.941 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:55.943 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:56.200 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:56.200 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:56.201 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:09:56.202 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:56.945 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:57.945 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:58.947 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:09:59.948 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:00.201 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:00.202 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:00.202 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:00.202 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:00.203 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:00.950 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:01.950 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:02.952 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:03.953 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:04.203 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:04.204 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:04.204 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:04.204 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:04.204 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:04.204 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:04.204 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:04.205 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:04.205 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:04.205 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:04.205 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:04.205 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:04.205 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:04.205 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:04.954 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:05.955 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:06.957 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:07.958 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:08.205 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:08.206 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:08.206 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:08.206 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:08.207 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:08.960 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:09.962 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:10.963 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:11.965 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:12.207 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:12.208 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:12.208 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:12.208 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:12.208 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:12.208 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:12.208 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:12.209 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:12.209 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:12.209 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:12.209 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:12.209 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:12.209 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:12.209 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:12.966 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:13.968 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:14.969 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:15.971 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:16.209 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:16.210 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:16.210 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:16.210 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:16.210 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:16.210 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:16.210 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:16.211 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:16.211 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:16.211 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:16.211 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:16.211 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:16.211 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:16.211 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:16.973 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:17.974 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:18.975 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:19.977 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:20.210 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:20.211 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:20.212 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:20.978 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:21.980 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:22.981 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:23.983 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:24.213 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:24.214 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:24.214 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:24.214 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:24.214 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:24.214 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:24.214 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:24.215 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:24.215 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:24.215 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:24.215 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:24.215 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:24.215 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:24.215 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:24.984 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:25.986 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:26.987 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:27.988 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:28.215 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:28.216 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:28.216 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:28.216 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:28.216 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:28.216 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:28.216 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:28.216 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:28.216 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:28.217 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:28.217 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:28.217 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:28.217 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:28.217 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:28.990 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:29.991 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:30.993 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:31.994 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:32.216 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:32.217 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:32.217 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:32.217 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:32.218 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:32.995 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:33.997 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:34.999 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:36.000 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:36.218 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:36.219 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:36.219 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:36.219 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:36.219 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:36.219 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:36.219 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:36.219 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:36.219 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:36.220 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:36.220 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:36.220 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:36.220 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:36.220 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:37.001 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:38.002 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:39.004 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:40.005 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:40.220 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:40.221 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:40.221 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:40.221 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:40.221 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:40.221 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:40.221 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:40.221 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:40.222 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:40.222 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:40.222 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:40.222 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:40.222 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:40.222 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:41.006 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:42.008 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:43.009 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:44.010 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:44.222 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:44.223 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:44.223 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:44.223 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:44.223 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:44.224 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:44.224 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:44.224 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:44.224 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:44.224 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:44.224 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:44.224 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:44.224 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:44.224 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:45.012 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:46.013 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:47.015 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:48.016 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:48.224 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:48.225 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:48.225 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:48.225 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:48.225 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:48.226 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:48.226 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:48.226 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:48.226 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:48.226 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:48.226 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:48.226 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:48.226 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:48.226 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:49.018 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:50.019 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:51.020 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:52.022 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:52.226 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:52.227 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:52.227 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:52.227 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:52.228 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:53.023 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:54.024 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:55.026 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:56.028 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:56.228 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:56.230 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:56.231 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:10:56.231 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:57.030 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:58.032 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:10:59.033 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:00.034 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:00.230 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:00.231 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:00.231 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:00.231 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:00.231 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:00.231 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:00.231 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:00.231 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:00.232 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:00.232 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:00.232 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:00.232 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:00.232 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:00.232 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:01.035 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:02.037 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:03.038 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:04.039 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:04.232 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:04.233 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:04.233 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:04.233 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:04.233 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:04.233 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:04.233 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:04.234 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:04.234 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:04.234 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:04.234 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:04.234 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:04.234 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:04.234 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:05.040 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:06.041 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:07.043 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:08.045 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:08.234 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:08.236 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:08.236 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:08.236 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:08.236 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:08.236 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:08.236 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:08.236 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:08.236 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:08.236 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:08.237 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:08.237 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:08.237 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:08.237 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:09.046 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:10.048 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:11.049 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:12.051 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:12.237 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:12.238 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:12.238 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:12.238 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:12.238 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:12.238 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:12.238 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:12.238 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:12.238 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:12.239 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:12.239 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:12.239 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:12.239 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:12.239 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:13.052 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:14.054 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:15.055 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:16.057 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:16.238 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:16.239 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:16.239 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:16.239 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:16.239 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:16.240 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:16.240 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:16.240 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:16.240 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:16.240 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:16.240 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:16.240 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:16.240 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:16.240 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:17.058 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:18.060 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:19.062 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:20.063 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:20.240 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:20.241 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:20.241 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:20.241 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:20.241 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:20.241 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:20.242 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:20.242 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:20.242 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:20.242 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:20.242 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:20.242 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:20.242 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:20.242 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:21.065 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:22.066 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:23.068 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:24.069 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:24.242 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:24.243 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:24.243 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:24.243 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:24.244 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:25.070 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:26.071 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:27.072 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:27.211 7fb2d42565e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:11:28.074 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:28.244 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:28.245 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:28.245 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:28.245 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:28.246 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:29.075 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:30.077 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:31.079 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:32.079 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:32.246 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:32.247 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:32.247 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:32.247 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:32.247 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:32.248 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:32.248 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:32.248 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:32.248 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:32.248 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:32.248 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:32.248 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:32.248 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:32.248 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:33.081 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:34.083 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:35.084 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:36.085 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:36.248 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:36.249 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:36.249 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:36.249 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:36.249 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:36.250 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:36.250 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:36.250 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:36.250 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:36.250 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:36.250 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:36.250 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:36.250 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:36.250 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:37.087 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:38.088 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:39.090 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:40.091 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:40.250 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:40.251 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:40.251 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:40.251 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:40.251 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:40.251 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:40.251 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:40.252 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:40.252 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:40.252 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:40.252 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:40.252 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:40.252 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:40.252 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:41.093 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:42.095 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:43.096 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:44.098 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:44.252 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:44.253 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:44.253 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:44.253 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:44.253 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:44.253 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:44.253 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:44.254 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:44.254 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:44.254 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:44.254 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:44.254 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:44.254 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:44.254 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:45.100 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:46.102 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:47.104 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:48.104 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:48.253 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:48.254 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:48.254 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:48.254 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:48.255 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:49.105 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:50.106 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:51.107 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:52.109 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:52.255 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:52.296 7fb2d42565e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:52.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:52.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:52.296 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:52.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:52.296 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:52.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:52.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:52.297 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:52.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:52.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:52.297 7fb2d42565e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:52.297 7fb2d42565e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:53.111 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:54.113 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:55.114 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:56.116 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:56.296 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:56.297 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:56.298 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:56.298 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:56.298 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:56.298 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:56.298 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:56.298 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:56.298 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:56.298 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:56.298 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:56.299 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:56.299 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:11:56.299 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:57.118 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:58.119 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:11:59.121 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:00.122 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:00.298 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:00.299 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:00.299 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:00.299 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:00.299 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:00.299 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:00.299 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:00.299 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:00.300 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:00.300 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:00.300 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:00.300 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:00.300 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:00.300 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:01.124 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:02.126 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:03.127 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:04.128 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:04.300 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:04.300 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:04.301 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.129 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:06.130 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:07.132 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:08.134 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:08.301 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:08.302 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:08.302 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:08.302 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:08.302 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:08.303 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:08.303 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:08.303 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:08.303 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:08.303 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:08.303 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:08.303 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:08.303 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:08.303 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.135 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:10.137 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:11.138 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:12.139 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:12.302 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:12.303 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:12.303 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:12.303 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:12.304 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:13.141 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:14.143 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:15.145 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:16.147 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:16.304 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:16.305 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:16.305 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:16.305 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:16.305 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:16.305 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:16.305 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:16.306 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:16.306 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:16.306 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:16.306 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:16.306 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:16.306 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:16.306 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:17.148 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:18.150 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:19.151 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:20.198 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:20.305 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:20.306 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:20.306 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:20.306 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:20.306 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:20.306 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:20.307 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:20.307 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:20.307 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:20.307 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:20.307 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:20.307 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:20.307 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:20.307 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:21.200 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:22.201 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:23.203 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:24.204 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:24.307 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:24.308 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:24.309 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:24.309 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:24.309 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:24.309 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:24.309 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:24.309 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:24.310 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:24.310 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:24.310 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:24.310 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:24.310 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:24.310 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:25.206 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:26.207 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:27.209 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:28.210 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:28.309 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:28.310 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:28.310 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:28.310 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:28.311 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:29.212 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:30.214 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:31.215 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:32.217 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:32.311 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:32.312 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:32.312 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:32.312 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:32.312 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:32.312 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:32.312 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:32.313 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:32.313 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:32.313 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:32.313 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:32.313 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:32.313 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:32.313 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.218 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:34.220 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:35.221 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:36.223 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:36.313 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:36.314 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:36.314 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:36.314 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:36.314 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:36.314 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:36.314 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:36.314 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:36.314 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:36.315 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:36.315 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:36.315 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:36.315 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:36.315 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:37.225 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:38.226 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:39.228 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:40.230 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:40.314 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:40.315 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:40.315 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:40.315 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:40.315 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:40.316 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:40.316 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:40.316 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:40.316 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:40.316 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:40.316 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:40.316 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:40.316 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:40.316 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:41.231 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:42.233 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:43.234 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:44.235 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:44.316 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:44.317 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:44.317 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:44.317 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:44.317 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:44.317 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:44.317 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:44.317 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:44.318 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:44.318 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:44.318 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:44.318 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:44.318 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:44.318 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:45.237 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:46.239 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:47.240 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:48.241 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:48.318 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:48.319 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:48.319 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:48.319 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:48.319 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:48.319 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:48.319 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:48.319 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:48.319 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:48.319 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:48.320 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:48.320 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:48.320 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:48.320 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:49.242 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:50.244 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:51.245 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:52.247 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:52.320 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:52.321 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:52.321 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:52.321 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:52.321 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:52.321 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:52.321 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:52.321 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:52.321 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:52.322 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:52.322 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:52.322 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:52.322 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:52.322 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:53.249 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:54.250 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:55.252 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:56.253 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:56.321 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:56.322 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:56.322 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:12:56.323 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:57.254 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:58.256 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:12:59.258 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:00.258 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:00.323 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:00.324 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:00.324 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:00.324 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:00.324 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:00.324 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:00.324 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:00.325 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:00.325 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:00.325 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:00.325 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:00.325 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:00.325 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:00.325 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.259 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:02.261 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:03.263 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:04.264 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:04.324 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:04.325 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:04.325 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:04.325 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:04.326 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:05.266 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:06.267 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:07.269 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:08.270 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:08.326 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:08.327 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:08.328 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:08.328 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:08.328 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:08.328 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:08.328 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:08.328 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:08.328 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:08.328 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:08.328 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:08.329 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:08.329 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:08.329 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:09.272 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:10.273 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:11.274 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:12.276 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:12.328 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:12.329 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:12.329 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:12.330 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:13.277 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:14.278 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:15.280 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:16.281 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:16.330 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:16.331 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:16.332 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:17.282 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:18.283 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:19.284 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:20.285 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:20.332 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:20.333 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:20.333 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:20.333 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:20.333 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:20.333 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:20.333 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:20.334 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:20.334 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:20.334 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:20.334 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:20.334 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:20.334 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:20.334 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:21.286 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:22.288 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:23.290 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:24.291 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:24.334 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:24.335 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:24.335 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:24.335 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:24.335 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:24.335 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:24.335 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:24.336 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:24.336 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:24.336 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:24.336 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:24.336 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:24.336 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:24.336 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:25.293 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:26.295 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:27.296 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:28.298 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:28.335 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:28.336 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:28.337 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:29.299 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:30.301 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:31.302 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:32.304 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:32.337 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:32.338 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:32.339 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:32.339 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:32.339 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:32.339 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:32.339 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:32.339 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:32.339 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:32.340 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:32.340 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:32.340 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:32.340 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:32.340 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:33.306 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:34.308 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:35.309 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:36.310 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:36.339 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:36.340 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:36.340 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:36.340 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:36.340 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:36.340 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:36.340 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:36.340 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:36.341 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:36.341 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:36.341 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:36.341 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:36.341 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:36.341 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:37.311 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:38.313 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:39.315 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:40.316 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:40.341 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:40.342 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:40.342 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:40.342 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:40.342 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:40.342 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:40.342 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:40.342 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:40.342 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:40.342 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:40.343 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:40.343 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:40.343 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:40.343 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:41.318 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:42.319 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:43.320 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:44.322 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:44.342 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:44.343 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:44.343 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:44.343 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:44.343 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:44.343 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:44.344 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:44.344 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:44.344 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:44.344 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:44.344 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:44.344 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:44.344 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:44.344 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:45.323 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:46.325 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:47.325 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:48.327 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:48.343 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:48.344 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:48.344 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:48.344 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:48.344 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:48.345 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:48.345 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:48.345 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:48.345 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:48.345 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:48.345 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:48.345 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:48.345 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:48.345 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:49.328 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:50.329 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:51.331 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:52.333 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:52.344 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:52.345 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:52.345 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:52.345 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:52.346 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.335 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:54.336 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:55.338 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:56.339 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:56.346 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:56.347 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:56.347 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:56.347 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:56.347 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:56.347 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:56.347 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:56.347 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:56.347 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:56.347 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:56.348 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:56.348 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:56.348 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:13:56.348 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:57.340 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:58.342 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:13:59.343 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:00.344 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:00.347 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:00.348 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:00.349 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:00.349 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:00.349 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:00.349 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:00.349 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:00.349 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:00.349 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:00.349 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:00.349 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:00.350 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:00.350 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:00.350 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:01.345 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:02.347 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:03.348 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:04.350 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:04.351 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:04.351 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:04.352 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:04.352 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:04.352 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:04.352 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:04.352 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:04.352 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:04.352 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:04.352 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:04.353 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:04.353 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:04.353 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:04.353 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:05.352 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:06.353 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:07.353 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:08.353 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:08.354 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:08.354 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:08.354 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:08.354 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:08.354 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:08.354 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:08.354 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:08.354 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:08.355 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:08.355 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:08.355 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:08.355 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:08.355 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:08.355 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:09.356 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:10.358 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:11.359 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:12.355 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:12.356 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:12.356 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:12.356 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:12.357 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:12.361 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:13.362 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:14.362 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:15.364 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:16.357 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:16.359 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:16.359 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:16.359 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:16.359 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:16.359 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:16.359 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:16.360 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:16.360 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:16.360 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:16.360 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:16.360 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:16.360 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:16.360 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:16.365 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:17.367 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:18.367 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:19.369 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:20.360 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:20.362 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:20.362 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:20.362 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:20.362 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:20.362 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:20.362 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:20.362 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:20.363 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:20.363 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:20.363 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:20.363 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:20.363 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:20.363 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:20.370 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:21.372 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:22.373 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:23.374 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:24.363 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:24.364 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:24.364 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:24.364 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:24.364 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:24.364 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:24.364 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:24.364 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:24.364 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:24.365 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:24.365 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:24.365 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:24.365 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:24.365 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:24.375 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:25.377 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:26.377 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:27.378 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:28.364 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:28.366 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:28.366 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:28.366 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:28.366 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:28.366 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:28.366 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:28.366 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:28.367 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:28.367 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:28.367 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:28.367 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:28.367 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:28.367 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:28.379 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:29.380 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:30.382 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:31.383 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:32.367 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:32.368 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:32.368 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:32.368 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:32.368 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:32.368 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:32.368 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:32.368 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:32.368 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:32.369 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:32.369 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:32.369 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:32.369 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:32.369 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:32.384 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:33.385 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:34.386 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:35.388 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:36.368 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:36.369 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:36.370 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:36.370 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:36.370 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:36.370 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:36.370 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:36.370 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:36.370 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:36.370 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:36.371 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:36.371 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:36.371 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:36.371 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:36.389 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:37.391 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:38.392 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:39.393 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:40.370 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:40.372 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:40.372 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:40.372 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:40.372 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:40.372 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:40.372 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:40.372 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:40.372 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:40.373 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:40.373 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:40.373 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:40.373 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:40.373 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:40.394 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:41.396 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:42.397 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:43.398 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:44.373 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:44.374 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:44.374 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:44.374 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:44.374 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:44.375 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:44.375 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:44.375 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:44.375 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:44.375 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:44.375 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:44.375 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:44.375 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:44.375 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:44.399 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:45.400 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:46.402 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:47.403 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:48.376 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:48.377 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:48.377 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:48.377 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:48.377 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:48.377 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:48.377 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:48.377 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:48.377 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:48.378 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:48.378 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:48.378 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:48.378 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:48.378 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:48.404 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:49.406 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:50.407 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:51.462 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:52.041 7fb2d4458680 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:14:52.377 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:52.387 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:52.387 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:52.388 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:52.388 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:52.388 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:52.388 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:52.388 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:52.388 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:52.388 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:52.389 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:52.389 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:52.389 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:52.389 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:52.463 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:53.464 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:54.466 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:54.590 7fb2d4458680 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:14:55.466 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:56.389 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:56.390 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:56.390 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:56.390 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:56.390 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:56.391 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:56.391 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:56.391 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:56.391 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:56.391 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:56.391 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:56.391 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:56.391 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:14:56.391 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:56.468 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:57.469 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:58.254 7fb2d4458680 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:14:58.471 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:14:59.472 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:00.391 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:00.392 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:00.392 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:00.392 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:00.392 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:00.392 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:00.393 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:00.393 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:00.393 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:00.393 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:00.393 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:00.393 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:00.393 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:00.393 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:00.473 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:01.475 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:02.476 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:03.477 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:04.394 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:04.395 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:04.395 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:04.395 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:04.395 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:04.395 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:04.395 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:04.395 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:04.396 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:04.396 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:04.396 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:04.396 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:04.396 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:04.396 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:04.478 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:05.480 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:06.481 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:07.483 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:08.396 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:08.397 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:08.397 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:08.397 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:08.397 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:08.397 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:08.397 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:08.397 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:08.397 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:08.398 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:08.398 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:08.398 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:08.398 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:08.398 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:08.484 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:09.485 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:10.486 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:11.487 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:12.398 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:12.399 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:12.399 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:12.399 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:12.399 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:12.399 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:12.399 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:12.400 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:12.400 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:12.400 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:12.400 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:12.400 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:12.400 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:12.400 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:12.488 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:13.490 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:14.492 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:15.493 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:16.400 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:16.401 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:16.401 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:16.401 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:16.401 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:16.401 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:16.401 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:16.401 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:16.401 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:16.402 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:16.402 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:16.402 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:16.402 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:16.402 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:16.494 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:17.496 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:18.497 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:19.498 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:20.402 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:20.403 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:20.403 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:20.403 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:20.403 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:20.403 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:20.404 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:20.404 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:20.404 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:20.404 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:20.404 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:20.404 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:20.404 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:20.404 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:20.500 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:21.502 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:22.503 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:23.505 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:24.404 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:24.405 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:24.405 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:24.405 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:24.406 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:24.506 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:25.507 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:26.509 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:27.510 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:28.406 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:28.407 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:28.407 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:28.407 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:28.407 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:28.407 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:28.407 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:28.408 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:28.408 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:28.408 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:28.408 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:28.408 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:28.408 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:28.408 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:28.512 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:29.513 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:30.515 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:31.516 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:32.408 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:32.409 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:32.409 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:32.409 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:32.410 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:32.518 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:33.519 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:34.521 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:35.522 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:36.411 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:36.412 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:36.413 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:36.413 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:36.413 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:36.413 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:36.413 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:36.413 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:36.413 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:36.414 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:36.414 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:36.414 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:36.414 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:36.414 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:36.523 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:37.525 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:38.526 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:39.528 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:40.414 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:40.415 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:40.415 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:40.416 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:40.529 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:41.530 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:42.532 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:43.533 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:44.416 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:44.417 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:44.417 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:44.417 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:44.418 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:44.535 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:45.535 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:46.537 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:47.538 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:48.419 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:48.420 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:48.420 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:48.420 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:48.420 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:48.420 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:48.420 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:48.420 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:48.420 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:48.421 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:48.421 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:48.421 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:48.421 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:48.421 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:48.539 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:49.541 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:50.542 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:51.544 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:52.421 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:52.422 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:52.422 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:52.422 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:52.422 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:52.422 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:52.422 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:52.423 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:52.423 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:52.423 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:52.423 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:52.423 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:52.423 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:52.423 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:52.545 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:53.547 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:54.549 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:55.550 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:56.423 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:56.424 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:15:56.425 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:56.551 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:57.552 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:58.553 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:15:59.554 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:00.425 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:00.426 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:00.427 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:00.555 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:01.556 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:02.557 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:03.558 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:04.427 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:04.428 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:04.428 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:04.429 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:04.560 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:05.561 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:06.562 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:07.588 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:08.430 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:08.431 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:08.432 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:08.432 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:08.432 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:08.432 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:08.432 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:08.432 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:08.432 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:08.432 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:08.433 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:08.433 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:08.433 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:08.433 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:08.589 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:09.591 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:10.593 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:11.593 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:12.433 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:12.434 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:12.434 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:12.434 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:12.434 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:12.434 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:12.434 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:12.435 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:12.435 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:12.435 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:12.435 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:12.435 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:12.435 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:12.435 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:12.594 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:13.595 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:14.597 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:15.598 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:16.435 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:16.436 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:16.436 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:16.436 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:16.436 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:16.436 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:16.436 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:16.437 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:16.437 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:16.437 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:16.437 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:16.437 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:16.437 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:16.437 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:16.600 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:17.601 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:18.602 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:19.603 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:20.437 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:20.438 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:20.438 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:20.438 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:20.438 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:20.439 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:20.439 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:20.439 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:20.439 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:20.439 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:20.439 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:20.439 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:20.439 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:20.439 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:20.605 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:21.606 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:22.608 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:23.609 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:24.440 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:24.441 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:24.441 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:24.441 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:24.441 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:24.441 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:24.441 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:24.441 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:24.442 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:24.442 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:24.442 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:24.442 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:24.442 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:24.442 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:24.610 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:25.612 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:26.613 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:27.614 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:28.442 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:28.443 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:28.443 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:28.443 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:28.444 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:28.444 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:28.444 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:28.444 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:28.444 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:28.444 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:28.444 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:28.444 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:28.445 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:28.445 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:28.616 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:29.618 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:30.619 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:31.621 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:32.445 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:32.446 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:32.446 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:32.446 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:32.446 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:32.446 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:32.446 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:32.447 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:32.447 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:32.447 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:32.447 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:32.447 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:32.447 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:32.447 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:32.622 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:33.623 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:34.625 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:35.626 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:36.446 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:36.447 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:36.448 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:36.642 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:37.128 7fb2d4458680 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:16:37.644 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:38.645 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:39.647 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:40.449 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:40.450 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:40.450 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:40.450 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:40.451 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:40.648 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:41.649 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:42.651 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:43.652 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:44.451 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:44.452 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:44.452 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:44.452 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:44.453 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:44.653 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:45.654 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:46.656 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:47.657 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:48.453 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:48.453 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:48.454 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:48.455 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:48.455 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:48.658 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:49.659 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:50.661 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:51.663 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:52.454 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:52.456 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:52.457 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:52.457 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:52.457 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:52.664 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:53.665 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:54.667 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:55.668 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:56.457 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:56.458 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:56.458 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:56.458 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:16:56.459 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:56.669 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:57.669 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:58.671 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:16:59.672 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:00.460 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:00.461 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:00.461 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:00.461 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:00.461 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:00.461 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:00.461 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:00.461 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:00.462 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:00.462 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:00.462 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:00.462 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:00.462 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:00.462 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:00.673 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:01.674 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:02.675 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:03.676 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:04.462 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:04.463 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:04.463 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:04.464 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:04.677 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:05.678 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:06.679 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:07.681 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:08.465 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:08.466 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:08.466 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:08.466 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:08.466 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:08.466 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:08.466 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:08.467 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:08.467 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:08.467 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:08.467 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:08.467 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:08.467 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:08.467 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:08.681 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:09.683 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:10.684 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:11.685 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:12.468 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:12.469 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:12.470 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:12.470 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:12.470 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:12.686 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:13.688 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:14.689 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:15.690 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:16.470 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:16.471 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:16.471 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:16.472 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:16.691 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:17.692 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:18.692 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:19.694 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:20.473 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:20.474 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:20.474 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:20.474 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:20.474 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:20.474 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:20.474 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:20.474 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:20.474 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:20.474 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:20.475 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:20.475 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:20.475 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:20.475 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:20.694 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:21.695 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:22.697 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:23.698 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:24.475 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:24.476 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:24.476 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:24.476 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:24.476 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:24.476 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:24.476 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:24.477 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:24.477 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:24.477 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:24.477 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:24.477 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:24.477 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:24.477 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:24.699 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:25.699 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:26.701 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:27.702 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:28.477 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:28.478 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:28.479 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:28.479 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:28.479 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:28.479 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:28.479 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:28.479 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:28.479 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:28.479 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:28.480 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:28.480 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:28.480 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:28.480 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:28.703 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:29.705 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:30.706 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:31.707 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:32.480 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:32.480 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:32.481 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:32.709 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:33.710 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:34.712 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:35.714 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:36.482 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:36.483 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:36.483 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:36.483 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:36.483 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:36.484 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:36.484 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:36.484 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:36.484 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:36.484 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:36.484 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:36.484 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:36.484 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:36.484 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:36.715 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:37.716 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:38.718 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:39.718 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:40.484 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:40.485 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:40.486 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:40.719 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:41.721 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:42.723 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:43.724 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:44.486 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:44.487 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:44.726 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:45.727 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:46.728 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:47.730 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:48.488 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:48.489 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:48.730 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:49.732 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:50.733 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:51.734 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:52.490 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:52.491 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:52.491 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:52.491 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:52.492 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:52.736 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:53.737 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:54.738 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:55.739 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:56.493 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:17:56.494 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:17:56.494 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:17:56.494 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:56.494 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:17:56.494 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:17:56.494 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:17:56.495 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:17:56.495 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:56.495 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:17:56.495 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:56.495 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:56.495 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:17:56.495 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:17:56.741 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:57.741 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:58.743 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:17:59.744 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:00.495 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:00.496 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:00.496 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:00.496 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:00.496 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:00.497 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:00.497 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:00.497 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:00.497 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:00.497 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:00.497 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:00.497 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:00.497 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:00.497 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:00.745 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:01.747 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:02.748 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:03.750 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:04.498 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:04.499 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:04.500 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:04.501 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:04.501 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:04.751 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:05.753 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:06.754 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:07.755 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:08.501 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:08.502 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:08.502 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:08.502 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:08.502 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:08.502 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:08.502 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:08.503 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:08.503 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:08.503 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:08.503 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:08.503 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:08.503 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:08.503 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:08.757 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:09.758 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:10.758 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:11.760 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:12.503 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:12.504 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:12.504 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:12.504 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:12.504 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:12.504 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:12.504 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:12.504 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:12.504 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:12.504 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:12.505 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:12.505 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:12.505 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:12.505 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:12.760 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:13.762 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:14.764 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:15.764 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:16.505 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:16.506 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:16.506 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:16.506 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:16.506 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:16.506 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:16.506 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:16.506 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:16.507 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:16.507 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:16.507 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:16.507 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:16.507 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:16.507 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:16.765 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:17.768 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:18.768 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:19.770 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:20.507 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:20.508 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:20.508 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:20.509 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:20.509 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:20.509 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:20.509 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:20.509 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:20.509 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:20.509 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:20.509 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:20.509 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:20.510 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:20.510 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:20.771 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:21.773 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:22.774 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:23.776 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:24.510 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:24.511 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:24.511 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:24.511 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:24.511 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:24.511 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:24.511 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:24.512 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:24.512 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:24.512 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:24.512 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:24.512 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:24.512 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:24.512 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:24.777 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:25.779 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:26.780 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:27.781 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:28.512 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:28.513 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:28.513 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:28.513 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:28.514 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:28.783 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:29.784 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:30.785 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:31.785 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:32.514 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:32.515 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:32.516 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:32.516 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:32.516 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:32.516 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:32.516 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:32.516 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:32.516 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:32.517 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:32.517 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:32.517 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:32.517 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:32.517 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:32.786 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:33.788 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:34.789 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:35.791 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:36.517 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:36.518 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:36.518 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:36.518 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:36.518 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:36.518 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:36.518 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:36.518 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:36.519 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:36.519 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:36.519 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:36.519 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:36.519 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:36.519 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:36.792 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:37.793 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:38.794 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:39.794 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:40.518 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:40.519 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:40.519 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:40.519 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:40.520 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:40.796 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:41.797 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:42.799 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:43.800 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:44.521 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:44.521 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:44.522 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:44.523 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:44.802 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:45.803 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:46.804 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:47.806 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:48.522 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:48.523 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:48.523 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:48.523 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:48.523 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:48.524 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:48.524 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:48.524 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:48.524 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:48.524 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:48.524 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:48.524 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:48.524 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:48.524 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:48.807 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:49.808 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:50.810 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:51.811 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:52.524 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:18:52.526 7fb2d4458680 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:18:52.526 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:18:52.526 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1 process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1454-1:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 111 http_port = 8096 start_time = 1756690482918542 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 02:18:52.527 7fb2d4458680 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:18:52.812 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:53.813 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:54.778 7fb2d4458680 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:18:54.814 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 09/01/2025 02:18:55.815 7fb2d4c02540 [contrail-device-manager] [DEBUG]: KombuAmqpClient: socket.timeout occurred while draining events, no events to process.