11/27/2025 05:05:22.687 7fa772251448 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 11/27/2025 05:05:22.687 7fa772251448 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 11/27/2025 05:05:22.688 7fa772251448 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 11/27/2025 05:05:22.688 7fa7698f5048 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 11/27/2025 05:05:22.689 7fa7698f5048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 11/27/2025 05:05:22.689 7fa7698f5048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/27/2025 05:05:22.689 7fa7698f5048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 11/27/2025 05:05:22.689 7fa7698f5048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.690 7fa7698f5048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/27/2025 05:05:22.690 7fa7698f5048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.690 7fa7698f5048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.690 7fa7698f5048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1764219922689677 collector_name = collector_ip = collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 11/27/2025 05:05:22.691 7fa7698f5048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.745 7fa772251448 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//'] 11/27/2025 05:05:22.754 7fa772251448 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 11/27/2025 05:05:22.755 7fa76986b2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.755 7fa76986b2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/27/2025 05:05:22.755 7fa76986b2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.755 7fa76986b2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.755 7fa76986b2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/27/2025 05:05:22.755 7fa76986b2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.759 7fa772251448 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 11/27/2025 05:05:22.760 7fa76986b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.760 7fa76986b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/27/2025 05:05:22.760 7fa76986b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.771 7fa772251448 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 11/27/2025 05:05:22.772 7fa76986f4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.772 7fa76986f4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/27/2025 05:05:22.773 7fa76986f4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.775 7fa772251448 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/27/2025 05:05:22.775 7fa7780f6978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.775 7fa7780f6978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/27/2025 05:05:22.775 7fa7780f6978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.783 7fa772251448 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 11/27/2025 05:05:22.783 7fa772251448 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 11/27/2025 05:05:22.783 7fa772251448 [contrail-device-manager] [WARNING]: initializing cassandra cluster 11/27/2025 05:05:22.783 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 11/27/2025 05:05:22.784 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 11/27/2025 05:05:22.784 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/27/2025 05:05:22.784 7fa76986bac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 11/27/2025 05:05:22.784 7fa76986bac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 11/27/2025 05:05:22.784 7fa7696e4828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.785 7fa7696e4828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:05:22.785 7fa7696e4828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.786 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 11/27/2025 05:05:22.788 7fa76f17c6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/27/2025 05:05:22.788 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 11/27/2025 05:05:22.788 7fa76986bac8 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 11/27/2025 05:05:22.858 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 11/27/2025 05:05:22.867 7fa7695fc198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.867 7fa7695fc198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 11/27/2025 05:05:22.867 7fa7695fc198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.875 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 11/27/2025 05:05:22.876 7fa7696bacc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.877 7fa7696bacc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:05:22.877 7fa7696bacc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:22.889 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 11/27/2025 05:05:22.918 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 11/27/2025 05:05:24.143 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:05:24.916 7fa772251448 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 11/27/2025 05:05:24.922 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:05:25.801 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:05:26.307 7fa772251448 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 11/27/2025 05:05:26.313 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:05:26.689 7fa7695bdb70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:05:26.691 7fa7695bdb70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:05:26.692 7fa7695bdb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:05:26.692 7fa7695bdb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:26.692 7fa7695bdb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:05:26.692 7fa7695bdb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:26.692 7fa7695bdb70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:05:26.693 7fa7695bdb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:05:26.693 7fa7695bdb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:26.693 7fa7695bdb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:05:26.693 7fa7695bdb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:26.693 7fa7695bdb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:26.693 7fa7695bdb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:05:26.693 7fa7695bdb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:27.745 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:05:28.544 7fa772251448 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 11/27/2025 05:05:28.550 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:05:29.711 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:05:30.577 7fa772251448 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 11/27/2025 05:05:30.582 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:05:30.695 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:05:30.697 7fa76d0b6eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:05:30.697 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:05:30.697 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:05:30.698 7fa76d0b6eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:32.856 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:05:34.199 7fa772251448 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 11/27/2025 05:05:34.206 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:05:34.697 7fa76eed2048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:05:34.699 7fa76eed2048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:05:34.699 7fa76eed2048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:05:34.699 7fa76eed2048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:34.700 7fa76eed2048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:05:34.700 7fa76eed2048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:34.700 7fa76eed2048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:05:34.700 7fa76eed2048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:05:34.700 7fa76eed2048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:34.700 7fa76eed2048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:05:34.701 7fa76eed2048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:34.701 7fa76eed2048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:34.701 7fa76eed2048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:05:34.701 7fa76eed2048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:34.919 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:05:35.641 7fa772251448 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 11/27/2025 05:05:35.647 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:05:35.648 7fa7696af048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:35.648 7fa7696af048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:05:35.648 7fa7696af048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:35.661 7fa772251448 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 11/27/2025 05:05:35.662 7fa7695cfc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:35.663 7fa7695cfc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 11/27/2025 05:05:35.663 7fa7695cfc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:35.675 7fa76de27d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:35.676 7fa76de27d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:05:35.677 7fa76de27d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:35.677 7fa772251448 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 11/27/2025 05:05:35.677 7fa772251448 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 11/27/2025 05:05:35.677 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/27/2025 05:05:35.678 7fa772251448 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4822-1. 11/27/2025 05:05:35.692 7fa76f17c6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/27/2025 05:05:35.719 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4822-1.'] 11/27/2025 05:05:35.727 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/27/2025 05:05:35.734 7fa76f17c6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/27/2025 05:05:35.740 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4822-1.'] 11/27/2025 05:05:36.196 7fa772251448 [contrail-device-manager] [DEBUG]: Fetching all containers 11/27/2025 05:05:36.874 7fa772251448 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 11/27/2025 05:05:37.274 7fa772251448 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4822-1..config_queue 11/27/2025 05:05:37.274 7fa772251448 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4822-1..tftp_queue 11/27/2025 05:05:37.755 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/27/2025 05:05:37.761 7fa76f17c6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/27/2025 05:05:37.775 7fa772251448 [contrail-device-manager] [WARNING]: Process 136 prepared to run in Full mode... 11/27/2025 05:05:37.775 7fa772251448 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 11/27/2025 05:05:37.775 7fa772251448 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 11/27/2025 05:05:37.778 7fa772251448 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 11/27/2025 05:05:37.778 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 11/27/2025 05:05:37.779 7fa772251448 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 11/27/2025 05:05:37.779 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 11/27/2025 05:05:37.780 7fa772251448 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 11/27/2025 05:05:37.780 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 11/27/2025 05:05:37.784 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 11/27/2025 05:05:37.786 7fa772251448 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 11/27/2025 05:05:37.786 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 11/27/2025 05:05:37.786 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 11/27/2025 05:05:37.786 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 11/27/2025 05:05:37.786 7fa772251448 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 11/27/2025 05:05:37.786 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 11/27/2025 05:05:37.786 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 11/27/2025 05:05:37.787 7fa772251448 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 11/27/2025 05:05:37.787 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 11/27/2025 05:05:37.787 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 11/27/2025 05:05:37.787 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 11/27/2025 05:05:37.787 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 11/27/2025 05:05:37.787 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 11/27/2025 05:05:37.788 7fa772251448 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 11/27/2025 05:05:37.788 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 11/27/2025 05:05:37.788 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 11/27/2025 05:05:37.788 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 11/27/2025 05:05:37.788 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 11/27/2025 05:05:37.788 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 11/27/2025 05:05:37.789 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 11/27/2025 05:05:37.789 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 11/27/2025 05:05:37.789 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 11/27/2025 05:05:37.794 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 11/27/2025 05:05:37.794 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 11/27/2025 05:05:37.794 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 11/27/2025 05:05:37.795 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 11/27/2025 05:05:37.795 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 11/27/2025 05:05:37.795 7fa772251448 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 11/27/2025 05:05:37.798 7fa772251448 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 11/27/2025 05:05:37.906 7fa768d3e630 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 11/27/2025 05:05:37.906 7fa768d3e630 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 11/27/2025 05:05:37.906 7fa768d4ceb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:37.907 7fa768d4ceb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/27/2025 05:05:37.907 7fa768d4ceb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:37.961 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4822-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4822-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4822-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 11/27/2025 05:05:37.974 7fa7695bd630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:37.975 7fa7695bd630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/27/2025 05:05:37.975 7fa7695bd630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:37.982 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/27/2025 05:05:38.000 7fa76f17c6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/27/2025 05:05:38.015 7fa76f17c6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4822-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4822-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4822-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 11/27/2025 05:05:38.700 7fa768cd2828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:05:38.701 7fa768cd2828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:05:38.701 7fa768cd2828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:05:38.701 7fa768cd2828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:38.701 7fa768cd2828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/27/2025 05:05:38.701 7fa768cd2828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:38.702 7fa768cd2828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:05:38.702 7fa768cd2828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:05:38.702 7fa768cd2828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:38.702 7fa768cd2828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/27/2025 05:05:38.702 7fa768cd2828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:38.702 7fa768cd2828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:38.702 7fa768cd2828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:05:38.702 7fa768cd2828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:42.703 7fa768c11780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:05:42.705 7fa768c11780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:05:42.705 7fa768c11780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:05:42.705 7fa768c11780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:42.705 7fa768c11780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/27/2025 05:05:42.706 7fa768c11780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:42.706 7fa768c11780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:05:42.706 7fa768c11780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:05:42.706 7fa768c11780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:42.706 7fa768c11780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/27/2025 05:05:42.706 7fa768c11780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:42.707 7fa768c11780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:42.707 7fa768c11780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:05:42.707 7fa768c11780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:44.100 7fa768cc70f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:44.101 7fa768cc70f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:05:44.101 7fa768cc70f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:46.706 7fa7682fb978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:05:46.713 7fa7682fb978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:05:46.714 7fa7682fb978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:05:46.714 7fa7682fb978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:46.714 7fa7682fb978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:05:46.714 7fa7682fb978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:46.714 7fa7682fb978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:05:46.714 7fa7682fb978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:05:46.714 7fa7682fb978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:46.715 7fa7682fb978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:05:46.715 7fa7682fb978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:46.715 7fa7682fb978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:46.715 7fa7682fb978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:05:46.715 7fa7682fb978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:50.714 7fa7695fccc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:05:50.717 7fa7695fccc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:05:50.717 7fa7695fccc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:05:50.717 7fa7695fccc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:50.717 7fa7695fccc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:05:50.717 7fa7695fccc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:50.717 7fa7695fccc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:05:50.718 7fa7695fccc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:05:50.718 7fa7695fccc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:50.718 7fa7695fccc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:05:50.718 7fa7695fccc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:50.718 7fa7695fccc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:50.718 7fa7695fccc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:05:50.718 7fa7695fccc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:54.717 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:05:54.718 7fa7682f86d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:05:54.719 7fa7682f86d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:05:54.719 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:54.719 7fa7682f86d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:05:54.719 7fa7682f86d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:54.719 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:05:54.719 7fa7682f86d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:05:54.719 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:54.719 7fa7682f86d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:05:54.720 7fa7682f86d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:54.720 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:54.720 7fa7682f86d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:05:54.720 7fa7682f86d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:58.719 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:05:58.721 7fa7682f86d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:05:58.721 7fa7682f86d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:05:58.721 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:58.721 7fa7682f86d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:05:58.722 7fa7682f86d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:05:58.722 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:05:58.722 7fa7682f86d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:05:58.722 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:58.722 7fa7682f86d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:05:58.722 7fa7682f86d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:58.722 7fa7682f86d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:05:58.722 7fa7682f86d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:05:58.722 7fa7682f86d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:02.723 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:02.724 7fa7695cfac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:02.724 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:02.725 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:02.726 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:06.726 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:06.727 7fa7695cfac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:06.727 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:06.727 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:06.727 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:06.727 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:06.727 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:06.728 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:06.728 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:06.728 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:06.728 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:06.728 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:06.728 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:06.728 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:10.727 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:10.731 7fa7695cfac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:10.732 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:10.732 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:10.732 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:10.732 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:10.732 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:10.732 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:10.732 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:10.732 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:10.733 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:10.733 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:10.733 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:10.733 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:14.733 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:14.734 7fa7695cfac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:14.734 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:14.734 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:14.735 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:14.735 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:14.735 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:14.735 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:14.735 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:14.735 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:14.735 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:14.735 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:14.735 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:14.736 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:18.735 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:18.736 7fa7695cfac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:18.736 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:18.736 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:18.736 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:18.736 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:18.736 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:18.737 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:18.737 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:18.737 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:18.737 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:18.737 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:18.737 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:18.737 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:22.737 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:22.739 7fa7695cfac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:22.739 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:22.740 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:22.740 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:22.740 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:22.740 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:22.740 7fa7695cfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:22.740 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:22.740 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:22.740 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:22.740 7fa7695cfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:22.741 7fa7695cfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:22.741 7fa7695cfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:26.740 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:26.741 7fa7696a2390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:26.742 7fa7696a2390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:26.742 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:26.742 7fa7696a2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:26.742 7fa7696a2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:26.742 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:26.742 7fa7696a2390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:26.743 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:26.743 7fa7696a2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:26.743 7fa7696a2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:26.743 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:26.743 7fa7696a2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:26.743 7fa7696a2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:30.743 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:30.744 7fa7696a2390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:30.744 7fa7696a2390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:30.744 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:30.744 7fa7696a2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:30.744 7fa7696a2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:30.744 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:30.744 7fa7696a2390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:30.744 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:30.745 7fa7696a2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:30.745 7fa7696a2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:30.745 7fa7696a2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:30.745 7fa7696a2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:30.745 7fa7696a2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:34.744 7fa7684480f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:34.746 7fa7684480f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:34.746 7fa7684480f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:34.746 7fa7684480f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:34.746 7fa7684480f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:34.746 7fa7684480f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:34.746 7fa7684480f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:34.747 7fa7684480f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:34.747 7fa7684480f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:34.747 7fa7684480f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:34.747 7fa7684480f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:34.747 7fa7684480f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:34.747 7fa7684480f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:34.747 7fa7684480f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:38.748 7fa76f343630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:38.749 7fa76f343630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:38.749 7fa76f343630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:38.749 7fa76f343630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:38.749 7fa76f343630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:38.750 7fa76f343630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:38.750 7fa76f343630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:38.750 7fa76f343630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:38.750 7fa76f343630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:38.750 7fa76f343630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:38.750 7fa76f343630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:38.750 7fa76f343630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:38.750 7fa76f343630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:38.750 7fa76f343630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:42.750 7fa76828f438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:42.751 7fa76828f438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:42.751 7fa76828f438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:42.751 7fa76828f438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:42.752 7fa76828f438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:42.752 7fa76828f438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:42.752 7fa76828f438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:42.752 7fa76828f438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:42.752 7fa76828f438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:42.752 7fa76828f438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:42.752 7fa76828f438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:42.753 7fa76828f438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:42.753 7fa76828f438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:42.753 7fa76828f438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:46.752 7fa7695c0630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:46.755 7fa7695c0630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:46.755 7fa7695c0630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:46.755 7fa7695c0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:46.755 7fa7695c0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:46.755 7fa7695c0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:46.755 7fa7695c0630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:46.756 7fa7695c0630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:46.756 7fa7695c0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:46.756 7fa7695c0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:46.756 7fa7695c0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:46.756 7fa7695c0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:46.756 7fa7695c0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:46.756 7fa7695c0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:50.756 7fa7682f60f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:50.757 7fa7682f60f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:50.758 7fa7682f60f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:50.758 7fa7682f60f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:50.758 7fa7682f60f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:50.758 7fa7682f60f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:50.758 7fa7682f60f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:50.758 7fa7682f60f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:50.758 7fa7682f60f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:50.759 7fa7682f60f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:50.759 7fa7682f60f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:50.759 7fa7682f60f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:50.759 7fa7682f60f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:50.759 7fa7682f60f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:54.758 7fa7695ba630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:54.759 7fa7695ba630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:54.759 7fa7695ba630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:54.759 7fa7695ba630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:54.759 7fa7695ba630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:54.760 7fa7695ba630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:54.760 7fa7695ba630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:54.760 7fa7695ba630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:54.760 7fa7695ba630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:54.760 7fa7695ba630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:54.760 7fa7695ba630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:54.760 7fa7695ba630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:54.761 7fa7695ba630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:54.761 7fa7695ba630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:58.760 7fa76f3b7a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:06:58.761 7fa76f3b7a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:06:58.762 7fa76f3b7a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:06:58.762 7fa76f3b7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:58.762 7fa76f3b7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:06:58.762 7fa76f3b7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:06:58.762 7fa76f3b7a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:06:58.762 7fa76f3b7a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:06:58.762 7fa76f3b7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:58.763 7fa76f3b7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:06:58.763 7fa76f3b7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:58.763 7fa76f3b7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:06:58.763 7fa76f3b7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:06:58.763 7fa76f3b7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:02.762 7fa7695d4b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:02.764 7fa7695d4b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:07:02.764 7fa7695d4b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:02.764 7fa7695d4b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:02.764 7fa7695d4b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:07:02.764 7fa7695d4b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:02.764 7fa7695d4b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:07:02.765 7fa7695d4b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:07:02.765 7fa7695d4b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:02.765 7fa7695d4b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:02.765 7fa7695d4b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:02.765 7fa7695d4b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:02.765 7fa7695d4b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:02.765 7fa7695d4b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:04.104 7fa772251448 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 11/27/2025 05:07:04.107 7fa772251448 [contrail-device-manager] [WARNING]: initializing cassandra cluster 11/27/2025 05:07:04.108 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 11/27/2025 05:07:04.108 7fa768d5db70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:04.108 7fa768d5db70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:07:04.108 7fa768d5db70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:04.109 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 11/27/2025 05:07:04.149 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 11/27/2025 05:07:04.166 7fa768359ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:04.167 7fa768359ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 11/27/2025 05:07:04.167 7fa768359ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:04.177 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 11/27/2025 05:07:04.178 7fa768359978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:04.179 7fa768359978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:07:04.179 7fa768359978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:04.202 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:05.276 7fa772251448 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 11/27/2025 05:07:05.282 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:05.304 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:05.781 7fa772251448 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 11/27/2025 05:07:05.786 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:05.786 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 11/27/2025 05:07:05.963 7fa772251448 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 11/27/2025 05:07:05.980 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:06.558 7fa772251448 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 11/27/2025 05:07:06.569 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:06.576 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:06.765 7fa7681c9cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:06.766 7fa7681c9cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:07:06.766 7fa7681c9cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:06.766 7fa7681c9cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:06.766 7fa7681c9cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:07:06.766 7fa7681c9cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:06.766 7fa7681c9cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:07:06.767 7fa7681c9cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:07:06.767 7fa7681c9cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:06.767 7fa7681c9cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:07:06.767 7fa7681c9cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:06.767 7fa7681c9cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:06.767 7fa7681c9cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:06.767 7fa7681c9cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:07.731 7fa772251448 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 11/27/2025 05:07:07.738 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:07.746 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:08.934 7fa772251448 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 11/27/2025 05:07:08.943 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:08.956 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:09.855 7fa772251448 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 11/27/2025 05:07:09.860 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:09.867 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:10.644 7fa772251448 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 11/27/2025 05:07:10.696 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:10.704 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:10.767 7fa7681cd6d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:10.768 7fa7681cd6d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:07:10.769 7fa7681cd6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:10.769 7fa7681cd6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:10.769 7fa7681cd6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:07:10.769 7fa7681cd6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:10.769 7fa7681cd6d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:07:10.769 7fa7681cd6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:07:10.769 7fa7681cd6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:10.769 7fa7681cd6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/27/2025 05:07:10.769 7fa7681cd6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:10.770 7fa7681cd6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:10.770 7fa7681cd6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:10.770 7fa7681cd6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:12.292 7fa772251448 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 11/27/2025 05:07:12.297 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:12.319 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:13.286 7fa772251448 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 11/27/2025 05:07:13.297 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:13.333 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/27/2025 05:07:14.239 7fa772251448 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 11/27/2025 05:07:14.249 7fa772251448 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/27/2025 05:07:14.250 7fa7695ce240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.250 7fa7695ce240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:14.253 7fa7695ce240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.399 7fa772251448 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//'] 11/27/2025 05:07:14.400 7fa772251448 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 11/27/2025 05:07:14.401 7fa7681e4240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.401 7fa7681e4240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/27/2025 05:07:14.401 7fa7681e4240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.401 7fa7681e4240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.401 7fa7681e4240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/27/2025 05:07:14.401 7fa7681e4240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.410 7fa772251448 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 11/27/2025 05:07:14.411 7fa7681e4e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.411 7fa7681e4e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:14.411 7fa7681e4e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.472 7fa772251448 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 11/27/2025 05:07:14.473 7fa7681e0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.473 7fa7681e0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/27/2025 05:07:14.474 7fa7681e0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.488 7fa772251448 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/27/2025 05:07:14.489 7fa7681cad68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.489 7fa7681cad68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:14.489 7fa7681cad68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.491 7fa768229e10 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 11/27/2025 05:07:14.492 7fa7681ccb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.492 7fa7681ccb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/27/2025 05:07:14.492 7fa7681ccb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.521 7fa768229e10 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/27/2025 05:07:14.521 7fa7681cad68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.522 7fa7681cad68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:14.522 7fa7681cad68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.769 7fa7681da2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:14.770 7fa7681da2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:07:14.771 7fa7681da2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:14.771 7fa7681da2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:14.771 7fa7681da2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:07:14.771 7fa7681da2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:14.772 7fa7681da2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:07:14.772 7fa7681da2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:07:14.772 7fa7681da2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.772 7fa7681da2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:14.772 7fa7681da2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.772 7fa7681da2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:14.772 7fa7681da2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:14.773 7fa7681da2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:18.771 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:18.773 7fa768266240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:07:18.773 7fa768266240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:18.773 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:18.773 7fa768266240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:07:18.773 7fa768266240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:18.773 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:07:18.773 7fa768266240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:07:18.773 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:18.774 7fa768266240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:18.774 7fa768266240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:18.774 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:18.774 7fa768266240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:18.774 7fa768266240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:22.773 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:22.777 7fa768266240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:07:22.777 7fa768266240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:22.777 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:22.777 7fa768266240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:07:22.777 7fa768266240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:22.777 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:07:22.778 7fa768266240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:07:22.778 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:22.778 7fa768266240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:22.778 7fa768266240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:22.778 7fa768266240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:22.778 7fa768266240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:22.778 7fa768266240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:26.778 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:26.779 7fa7695eb390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:07:26.779 7fa7695eb390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:26.779 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:26.780 7fa7695eb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:30.780 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:30.782 7fa7695eb390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:07:30.782 7fa7695eb390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:30.782 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:30.782 7fa7695eb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:07:30.782 7fa7695eb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:30.782 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:07:30.782 7fa7695eb390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:07:30.782 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:30.783 7fa7695eb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:30.783 7fa7695eb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:30.783 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:30.783 7fa7695eb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:30.783 7fa7695eb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:34.783 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:34.786 7fa7695eb390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/27/2025 05:07:34.786 7fa7695eb390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:34.786 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:34.786 7fa7695eb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:07:34.786 7fa7695eb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:34.786 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/27/2025 05:07:34.786 7fa7695eb390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/27/2025 05:07:34.787 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:34.787 7fa7695eb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/27/2025 05:07:34.787 7fa7695eb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:34.787 7fa7695eb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:34.787 7fa7695eb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:34.787 7fa7695eb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:36.563 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4822-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-2.'], 'id_perms': {'created': '2025-11-27T05:07:36.548102', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:07:36.548102', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10338676598643502770, 'uuid_mslong': 5727462395644102259}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4f7c08b4-14c6-4673-8f7a-5b96fdca2eb2'}, 'oper': 'CREATE', 'request-id': 'req-db6bdb7f-a061-4bee-97ac-68b203c43313', 'type': 'analytics_node', 'uuid': '4f7c08b4-14c6-4673-8f7a-5b96fdca2eb2'} 11/27/2025 05:07:36.593 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4822-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-1.'], 'id_perms': {'created': '2025-11-27T05:07:36.574640', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:07:36.574640', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9773820836377414684, 'uuid_mslong': 12134980375908665360}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a8681c5b-a65f-4810-87a3-96444a964c1c'}, 'oper': 'CREATE', 'request-id': 'req-1463eda1-065d-4526-88a9-ed9cc7869925', 'type': 'analytics_node', 'uuid': 'a8681c5b-a65f-4810-87a3-96444a964c1c'} 11/27/2025 05:07:36.616 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4822-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-3.'], 'id_perms': {'created': '2025-11-27T05:07:36.577950', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:07:36.577950', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13432096563023465906, 'uuid_mslong': 13845321020583331797}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c024761c-d11e-47d5-ba68-64a863c24db2'}, 'oper': 'CREATE', 'request-id': 'req-4dface0a-27f0-4ffd-99eb-09b6f9be1bc9', 'type': 'analytics_node', 'uuid': 'c024761c-d11e-47d5-ba68-64a863c24db2'} 11/27/2025 05:07:38.787 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:38.788 7fa768103c18 [contrail-device-manager] [INFO]: Session Event: TCP Connected 11/27/2025 05:07:38.788 7fa768103c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:38.788 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:38.788 7fa768103c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:07:38.789 7fa768103c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:38.789 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/27/2025 05:07:38.789 7fa768103c18 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 11/27/2025 05:07:38.789 7fa768103c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/27/2025 05:07:38.789 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 05:07:38.789 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 05:07:38.789 7fa7681d1978 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/27/2025 05:07:38.790 7fa7681d1978 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/27/2025 05:07:49.267 7fa7681d1438 [contrail-device-manager] [ERROR]: Session Event: TCP Connection Closed 11/27/2025 05:07:49.267 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 11/27/2025 05:07:49.268 7fa768103c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 11/27/2025 05:07:49.268 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:49.268 7fa768103c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 11/27/2025 05:07:49.268 7fa768103c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:49.268 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:49.268 7fa768103c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 1 pid = 136 http_port = 8096 start_time = 1764219922689677 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.50:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/27/2025 05:07:49.268 7fa768103c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/27/2025 05:07:53.269 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/27/2025 05:07:53.270 7fa768103c18 [contrail-device-manager] [INFO]: Session Event: TCP Connected 11/27/2025 05:07:53.270 7fa768103c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/27/2025 05:07:53.270 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:53.270 7fa768103c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4822-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/27/2025 05:07:53.270 7fa768103c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/27/2025 05:07:53.270 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/27/2025 05:07:53.271 7fa768103c18 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 11/27/2025 05:07:53.271 7fa768103c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/27/2025 05:07:53.271 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 05:07:53.271 7fa768103c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/27/2025 05:07:53.271 7fa768102240 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/27/2025 05:07:53.272 7fa768102240 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/27/2025 05:07:53.291 7fa7681d1ac8 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 11/27/2025 05:07:53.291 7fa7681d1ac8 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/27/2025 05:07:53.292 7fa7681d1d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 11/27/2025 05:07:53.292 7fa7681d1d68 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 11/27/2025 05:07:53.292 7fa7681d1d68 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/27/2025 05:07:53.292 7fa7681d1d68 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/27/2025 05:07:53.292 7fa7681d1d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 11/27/2025 05:07:53.292 7fa768102f60 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/27/2025 05:07:53.293 7fa768102f60 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/27/2025 05:07:53.774 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4822-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-2.'], 'id_perms': {'created': '2025-11-27T05:07:53.758105', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:07:53.758105', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9659189240899280966, 'uuid_mslong': 12596072329357050151}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'aece3d0b-f474-4127-860c-55702213a046'}, 'oper': 'CREATE', 'request-id': 'req-928dc696-20c5-491f-b71c-a711cb72bb36', 'type': 'analytics_alarm_node', 'uuid': 'aece3d0b-f474-4127-860c-55702213a046'} 11/27/2025 05:07:53.824 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4822-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-3.'], 'id_perms': {'created': '2025-11-27T05:07:53.799107', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:07:53.799107', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12168486005598490628, 'uuid_mslong': 11036574454777266355}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9929c9fe-0a26-40b3-a8df-258cfa029004'}, 'oper': 'CREATE', 'request-id': 'req-9b557fd7-98d3-488f-8cb7-637b47c139c4', 'type': 'analytics_alarm_node', 'uuid': '9929c9fe-0a26-40b3-a8df-258cfa029004'} 11/27/2025 05:07:53.995 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4822-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-1.'], 'id_perms': {'created': '2025-11-27T05:07:53.976876', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:07:53.976876', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10231954444890362496, 'uuid_mslong': 1814217642748298506}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '192d6555-7d42-450a-8dff-345b3dab5280'}, 'oper': 'CREATE', 'request-id': 'req-84e81236-7415-45c0-998b-9033e1faf3eb', 'type': 'analytics_alarm_node', 'uuid': '192d6555-7d42-450a-8dff-345b3dab5280'} 11/27/2025 05:07:59.196 7fa7681d1ac8 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 11/27/2025 05:07:59.196 7fa7681d1ac8 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/27/2025 05:07:59.196 7fa7696ac390 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 11/27/2025 05:07:59.197 7fa7696ac390 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 11/27/2025 05:07:59.197 7fa7696ac390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/27/2025 05:07:59.197 7fa7696ac390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/27/2025 05:08:05.317 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4822-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-3.'], 'id_perms': {'created': '2025-11-27T05:08:05.302902', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:08:05.302902', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13759030233444338906, 'uuid_mslong': 3965613909729231611}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3708b0d7-15c2-42fb-bef1-e5194e4f4cda'}, 'oper': 'CREATE', 'request-id': 'req-0ee46e23-9ffd-4a9c-af43-b1df15b76f59', 'type': 'analytics_snmp_node', 'uuid': '3708b0d7-15c2-42fb-bef1-e5194e4f4cda'} 11/27/2025 05:08:05.802 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4822-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-2.'], 'id_perms': {'created': '2025-11-27T05:08:05.787483', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:08:05.787483', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13572858350631947869, 'uuid_mslong': 13583801519850735493}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bc835b83-221d-4785-bc5c-7ac2001c8e5d'}, 'oper': 'CREATE', 'request-id': 'req-dd0778bf-ad93-433f-aff4-4fc57f0d021c', 'type': 'analytics_snmp_node', 'uuid': 'bc835b83-221d-4785-bc5c-7ac2001c8e5d'} 11/27/2025 05:08:05.951 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4822-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4822-1.'], 'id_perms': {'created': '2025-11-27T05:08:05.938356', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:08:05.938356', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9579756145806412734, 'uuid_mslong': 3966769265555163888}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '370ccba1-535a-4af0-84f2-217579a80bbe'}, 'oper': 'CREATE', 'request-id': 'req-3bb845fe-828d-4701-9889-04c1d9afd5ce', 'type': 'analytics_snmp_node', 'uuid': '370ccba1-535a-4af0-84f2-217579a80bbe'} 11/27/2025 05:09:50.795 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-1f744a38-d04e-4c37-b373-6bc03e754d63', 'type': 'global_system_config', 'uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721'} 11/27/2025 05:09:50.877 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e65d33e9-7deb-46bb-a72a-87f954086f31', 'type': 'global_system_config', 'uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721'} 11/27/2025 05:09:50.966 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4822-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-1'], 'id_perms': {'created': '2025-11-27T05:09:50.947256', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:09:50.947256', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12686703087446527748, 'uuid_mslong': 2287683914632546221}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1fbf7c66-520c-47ad-b010-393db21a0f04', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-99c1a7fb-d643-4811-9aa2-174daf0cea6e', 'type': 'virtual_router', 'uuid': '1fbf7c66-520c-47ad-b010-393db21a0f04'} 11/27/2025 05:09:51.081 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4822-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-2'], 'id_perms': {'created': '2025-11-27T05:09:51.070161', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:09:51.070161', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11191129978189942913, 'uuid_mslong': 16116877996746491850}}, 'parent_type': 'global-system-config', 'parent_uuid': 'fff1c008-2cf0-4b2a-b312-891805d3a721', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dfaaa725-ac62-47ca-9b4e-e16c093c9081', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.129'}, 'oper': 'CREATE', 'request-id': 'req-95e3eb53-fea9-4413-8f57-5c233593a739', 'type': 'virtual_router', 'uuid': 'dfaaa725-ac62-47ca-9b4e-e16c093c9081'} 11/27/2025 05:09:51.358 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-1', 'vhost0'], 'id_perms': {'created': '2025-11-27T05:09:51.336841', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:09:51.336841', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13645454790127185248, 'uuid_mslong': 18329663212992546981}}, 'parent_type': 'virtual-router', 'parent_uuid': '1fbf7c66-520c-47ad-b010-393db21a0f04', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fe600b93-d6f7-48a5-bd5e-64d5bc2eed60', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:fe:60:0b:93:d6']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'ff54efe0-9903-4714-a556-76ffe516f513'}]}, 'oper': 'CREATE', 'request-id': 'req-2c36ffd2-35cf-42eb-8a84-23837249f5eb', 'type': 'virtual_machine_interface', 'uuid': 'fe600b93-d6f7-48a5-bd5e-64d5bc2eed60'} 11/27/2025 05:09:51.434 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-2c36ffd2-35cf-42eb-8a84-23837249f5eb', 'type': 'virtual_machine_interface', 'uuid': 'fe600b93-d6f7-48a5-bd5e-64d5bc2eed60'} 11/27/2025 05:09:51.472 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-2', 'vhost0'], 'id_perms': {'created': '2025-11-27T05:09:51.429686', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-27T05:09:51.429686', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11294716441011090560, 'uuid_mslong': 12821012396326470123}}, 'parent_type': 'virtual-router', 'parent_uuid': 'dfaaa725-ac62-47ca-9b4e-e16c093c9081', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b1ed62d8-87eb-41eb-9cbe-e4c2d93af480', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:b1:ed:62:d8:87']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'ff54efe0-9903-4714-a556-76ffe516f513'}]}, 'oper': 'CREATE', 'request-id': 'req-440f26b9-d9c2-4b0e-8225-7cda11bb60f0', 'type': 'virtual_machine_interface', 'uuid': 'b1ed62d8-87eb-41eb-9cbe-e4c2d93af480'} 11/27/2025 05:09:51.507 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4822-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-440f26b9-d9c2-4b0e-8225-7cda11bb60f0', 'type': 'virtual_machine_interface', 'uuid': 'b1ed62d8-87eb-41eb-9cbe-e4c2d93af480'} 11/27/2025 05:09:51.909 7fa76825b390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-5e80433a-c5f5-4f47-8858-cc7786a3b293', 'type': 'access_control_list', 'uuid': '264b28a8-3e52-4b47-9299-0b8ef0da3c96'}