05/05/2025 00:42:21.663 7f9085436e88 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 05/05/2025 00:42:21.663 7f9085436e88 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 05/05/2025 00:42:21.663 7f9085436e88 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 05/05/2025 00:42:21.663 7f907ca752e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 05/05/2025 00:42:21.664 7f907ca752e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 05/05/2025 00:42:21.664 7f907ca752e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/05/2025 00:42:21.664 7f907ca752e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 05/05/2025 00:42:21.664 7f907ca752e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.665 7f907ca752e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/05/2025 00:42:21.665 7f907ca752e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.665 7f907ca752e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.665 7f907ca752e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 start_time = 1746405741664497 collector_name = collector_ip = collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 05/05/2025 00:42:21.665 7f907ca752e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.710 7f9085436e88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.33:5673//', 'pyamqp://guest:guest@10.0.0.56:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//'] 05/05/2025 00:42:21.718 7f9085436e88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 05/05/2025 00:42:21.719 7f907c9c6588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.719 7f907c9c6588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 05/05/2025 00:42:21.719 7f907c9c6588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.719 7f907c9c6588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.719 7f907c9c6588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 05/05/2025 00:42:21.719 7f907c9c6588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.723 7f9085436e88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 05/05/2025 00:42:21.723 7f907c9c6240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.723 7f907c9c6240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/05/2025 00:42:21.723 7f907c9c6240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.742 7f9085436e88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 05/05/2025 00:42:21.743 7f907c9c60f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.743 7f907c9c60f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 05/05/2025 00:42:21.743 7f907c9c60f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.750 7f9085436e88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 05/05/2025 00:42:21.751 7f907c9c6240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.751 7f907c9c6240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/05/2025 00:42:21.751 7f907c9c6240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.803 7f9085436e88 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 05/05/2025 00:42:21.804 7f9085436e88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 05/05/2025 00:42:21.804 7f9085436e88 [contrail-device-manager] [WARNING]: initializing cassandra cluster 05/05/2025 00:42:21.804 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 05/05/2025 00:42:21.804 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 05/05/2025 00:42:21.804 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 05/05/2025 00:42:21.805 7f907f213978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 05/05/2025 00:42:21.805 7f907f213978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 05/05/2025 00:42:21.805 7f907c863588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.805 7f907c863588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:42:21.806 7f907c863588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.807 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 05/05/2025 00:42:21.810 7f90822fd6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 05/05/2025 00:42:21.810 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 05/05/2025 00:42:21.810 7f907f213978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 05/05/2025 00:42:21.840 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 05/05/2025 00:42:21.841 7f907c7b4828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.841 7f907c7b4828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 05/05/2025 00:42:21.841 7f907c7b4828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.849 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 05/05/2025 00:42:21.849 7f907c777240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.849 7f907c777240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:42:21.849 7f907c777240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:21.857 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 05/05/2025 00:42:21.879 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 05/05/2025 00:42:22.967 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:42:23.839 7f9085436e88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 05/05/2025 00:42:23.847 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:42:25.352 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:42:25.664 7f907c76b8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:42:25.665 7f907c76b8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:42:25.665 7f907c76b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:42:25.666 7f907c76b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:25.666 7f907c76b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:42:25.666 7f907c76b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:25.666 7f907c76b8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:42:25.666 7f907c76b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:42:25.666 7f907c76b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:25.666 7f907c76b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:42:25.666 7f907c76b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:25.666 7f907c76b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:25.667 7f907c76b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:42:25.667 7f907c76b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:25.878 7f9085436e88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 05/05/2025 00:42:25.883 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:42:27.726 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:42:29.270 7f9085436e88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 05/05/2025 00:42:29.276 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:42:29.666 7f9080fb2240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:42:29.667 7f9080fb2240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:42:29.667 7f9080fb2240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:42:29.667 7f9080fb2240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:29.667 7f9080fb2240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:42:29.667 7f9080fb2240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:29.667 7f9080fb2240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:42:29.667 7f9080fb2240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:42:29.668 7f9080fb2240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:29.668 7f9080fb2240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:42:29.668 7f9080fb2240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:29.668 7f9080fb2240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:29.668 7f9080fb2240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:42:29.668 7f9080fb2240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:31.256 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:42:32.965 7f9085436e88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 05/05/2025 00:42:32.973 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:42:33.667 7f907c733d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:42:33.668 7f907c733d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:42:33.668 7f907c733d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:42:33.668 7f907c733d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:42:33.669 7f907c733d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:34.869 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:42:34.871 7f9085436e88 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 05/05/2025 00:42:34.874 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:42:36.674 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:42:37.370 7f9085436e88 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 05/05/2025 00:42:37.375 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:42:37.376 7f907c743780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.376 7f907c743780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:42:37.376 7f907c743780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.396 7f9085436e88 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 05/05/2025 00:42:37.397 7f907c756a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.397 7f907c756a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 05/05/2025 00:42:37.397 7f907c756a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.410 7f907c756828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.410 7f907c756828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:42:37.410 7f907c756828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.411 7f9085436e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 05/05/2025 00:42:37.411 7f9085436e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 05/05/2025 00:42:37.411 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 05/05/2025 00:42:37.411 7f9085436e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3262-2. 05/05/2025 00:42:37.417 7f90822fd6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 05/05/2025 00:42:37.470 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3262-2.'] 05/05/2025 00:42:37.491 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 05/05/2025 00:42:37.495 7f90822fd6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 05/05/2025 00:42:37.522 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3262-2.'] 05/05/2025 00:42:37.669 7f907c7520f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:42:37.670 7f907c7520f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:42:37.670 7f907c7520f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:42:37.670 7f907c7520f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:37.670 7f907c7520f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:42:37.670 7f907c7520f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:37.670 7f907c7520f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:42:37.671 7f907c7520f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:42:37.671 7f907c7520f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.671 7f907c7520f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:42:37.671 7f907c7520f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.671 7f907c7520f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.671 7f907c7520f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:42:37.671 7f907c7520f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:37.923 7f9085436e88 [contrail-device-manager] [DEBUG]: Fetching all containers 05/05/2025 00:42:37.961 7f9085436e88 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 05/05/2025 00:42:38.141 7f9085436e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3262-2..config_queue 05/05/2025 00:42:38.142 7f9085436e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3262-2..tftp_queue 05/05/2025 00:42:38.538 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 05/05/2025 00:42:38.542 7f90822fd6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 05/05/2025 00:42:38.600 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3262-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3262-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3262-2..tftp_queue'] 05/05/2025 00:42:38.642 7f9085436e88 [contrail-device-manager] [WARNING]: Process 137 prepared to run in Full mode... 05/05/2025 00:42:38.642 7f9085436e88 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 05/05/2025 00:42:38.642 7f9085436e88 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 05/05/2025 00:42:38.645 7f9085436e88 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 05/05/2025 00:42:38.645 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 05/05/2025 00:42:38.646 7f9085436e88 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 05/05/2025 00:42:38.646 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 05/05/2025 00:42:38.647 7f9085436e88 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 05/05/2025 00:42:38.647 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 05/05/2025 00:42:38.651 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 05/05/2025 00:42:38.653 7f9085436e88 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 05/05/2025 00:42:38.653 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 05/05/2025 00:42:38.653 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 05/05/2025 00:42:38.653 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 05/05/2025 00:42:38.653 7f9085436e88 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 05/05/2025 00:42:38.653 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 05/05/2025 00:42:38.653 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 05/05/2025 00:42:38.654 7f9085436e88 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 05/05/2025 00:42:38.654 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 05/05/2025 00:42:38.654 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 05/05/2025 00:42:38.654 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 05/05/2025 00:42:38.654 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 05/05/2025 00:42:38.654 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 05/05/2025 00:42:38.655 7f9085436e88 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 05/05/2025 00:42:38.655 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 05/05/2025 00:42:38.655 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 05/05/2025 00:42:38.655 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 05/05/2025 00:42:38.655 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 05/05/2025 00:42:38.655 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 05/05/2025 00:42:38.656 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 05/05/2025 00:42:38.656 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 05/05/2025 00:42:38.656 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 05/05/2025 00:42:38.656 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 05/05/2025 00:42:38.656 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 05/05/2025 00:42:38.656 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 05/05/2025 00:42:38.656 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 05/05/2025 00:42:38.656 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 05/05/2025 00:42:38.656 7f9085436e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 05/05/2025 00:42:38.658 7f9085436e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 05/05/2025 00:42:38.672 7f907c68b780 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 05/05/2025 00:42:38.672 7f907c68b780 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 05/05/2025 00:42:38.713 7f907763e0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:38.714 7f907763e0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 05/05/2025 00:42:38.714 7f907763e0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:38.723 7f9077574588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:38.723 7f9077574588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 05/05/2025 00:42:38.723 7f9077574588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:39.613 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 05/05/2025 00:42:39.622 7f90822fd6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 05/05/2025 00:42:39.659 7f90822fd6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3262-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3262-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3262-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 05/05/2025 00:42:41.670 7f9077503ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:42:41.671 7f9077503ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:42:41.671 7f9077503ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:42:41.671 7f9077503ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:42:41.672 7f9077503ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:44.855 7f90774a6a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:44.855 7f90774a6a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:42:44.855 7f90774a6a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:45.671 7f90774b10f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:42:45.672 7f90774b10f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:42:45.672 7f90774b10f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:45.673 7f90774b10f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:42:45.674 7f90774b10f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:49.673 7f907742bb70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:42:49.675 7f907742bb70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:42:49.675 7f907742bb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:42:49.675 7f907742bb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:49.675 7f907742bb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:42:49.675 7f907742bb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:49.675 7f907742bb70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:42:49.675 7f907742bb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:42:49.675 7f907742bb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:49.676 7f907742bb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:42:49.676 7f907742bb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:49.676 7f907742bb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:49.676 7f907742bb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:42:49.676 7f907742bb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:53.675 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:42:53.676 7f90775036d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:42:53.676 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:42:53.676 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:53.676 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:42:53.676 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:53.676 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:42:53.677 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:42:53.677 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:53.677 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:42:53.677 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:53.677 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:53.677 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:42:53.677 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:57.678 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:42:57.679 7f90775036d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:42:57.679 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:42:57.679 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:57.680 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:42:57.680 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:42:57.680 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:42:57.680 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:42:57.680 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:57.680 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:42:57.680 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:57.680 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:42:57.680 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:42:57.681 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:01.681 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:01.682 7f90775036d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:01.682 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:01.682 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:01.682 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:01.682 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:01.682 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:01.682 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:01.683 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:01.683 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:01.683 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:01.683 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:01.683 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:01.683 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:05.683 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:05.685 7f90775036d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:05.685 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:05.685 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:05.685 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:05.685 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:05.685 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:05.685 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:05.685 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:05.686 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:05.686 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:05.686 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:05.686 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:05.686 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:09.686 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:09.687 7f90775036d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:09.688 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:09.688 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:09.688 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:09.688 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:09.688 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:09.688 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:09.689 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:09.689 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:09.689 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:09.689 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:09.689 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:09.689 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:13.688 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:13.689 7f90775036d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:13.689 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:13.689 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:13.689 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:13.689 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:13.689 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:13.690 7f90775036d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:13.690 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:13.690 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:13.690 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:13.690 7f90775036d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:13.690 7f90775036d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:13.690 7f90775036d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:17.690 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:17.691 7f907746a8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:17.691 7f907746a8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:17.691 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:17.692 7f907746a8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:21.692 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:21.693 7f907746a8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:21.693 7f907746a8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:21.693 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:21.693 7f907746a8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:21.693 7f907746a8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:21.693 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:21.694 7f907746a8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:21.694 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:21.694 7f907746a8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:21.694 7f907746a8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:21.694 7f907746a8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:21.694 7f907746a8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:21.694 7f907746a8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:25.694 7f907c894438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:25.695 7f907c894438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:25.695 7f907c894438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:25.695 7f907c894438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:25.695 7f907c894438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:25.695 7f907c894438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:25.695 7f907c894438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:25.696 7f907c894438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:25.696 7f907c894438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:25.696 7f907c894438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:25.696 7f907c894438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:25.696 7f907c894438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:25.696 7f907c894438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:25.696 7f907c894438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:29.696 7f90773ca630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:29.697 7f90773ca630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:29.697 7f90773ca630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:29.697 7f90773ca630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:29.697 7f90773ca630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:29.697 7f90773ca630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:29.697 7f90773ca630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:29.698 7f90773ca630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:29.698 7f90773ca630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:29.698 7f90773ca630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:29.698 7f90773ca630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:29.698 7f90773ca630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:29.698 7f90773ca630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:29.698 7f90773ca630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:33.698 7f9077428828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:33.699 7f9077428828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:33.699 7f9077428828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:33.699 7f9077428828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:33.700 7f9077428828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:37.699 7f9077428048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:37.700 7f9077428048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:37.701 7f9077428048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:37.702 7f9077428048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:37.702 7f9077428048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:41.701 7f9077428198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:41.704 7f9077428198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:41.704 7f9077428198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:41.704 7f9077428198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:41.704 7f9077428198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:41.704 7f9077428198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:41.704 7f9077428198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:41.705 7f9077428198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:41.705 7f9077428198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:41.705 7f9077428198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:41.705 7f9077428198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:41.705 7f9077428198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:41.705 7f9077428198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:41.705 7f9077428198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:45.704 7f907c863048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:45.706 7f907c863048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:45.706 7f907c863048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:45.706 7f907c863048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:45.706 7f907c863048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:45.706 7f907c863048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:45.706 7f907c863048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:45.706 7f907c863048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:45.706 7f907c863048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:45.706 7f907c863048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:45.707 7f907c863048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:45.707 7f907c863048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:45.707 7f907c863048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:45.707 7f907c863048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:49.707 7f907750e048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:49.712 7f907750e048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:49.712 7f907750e048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:49.712 7f907750e048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:49.713 7f907750e048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:49.713 7f907750e048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:49.713 7f907750e048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:49.713 7f907750e048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:49.713 7f907750e048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:49.714 7f907750e048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:49.714 7f907750e048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:49.714 7f907750e048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:49.714 7f907750e048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:49.714 7f907750e048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.713 7f907746d630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:53.715 7f907746d630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:53.715 7f907746d630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:53.715 7f907746d630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:53.716 7f907746d630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.730 7f9085436e88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 05/05/2025 00:43:53.731 7f9085436e88 [contrail-device-manager] [WARNING]: initializing cassandra cluster 05/05/2025 00:43:53.731 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 05/05/2025 00:43:53.731 7f90773c7240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.731 7f90773c7240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:43:53.731 7f90773c7240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.732 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 05/05/2025 00:43:53.757 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 05/05/2025 00:43:53.760 7f907758ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.761 7f907758ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 05/05/2025 00:43:53.761 7f907758ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.774 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 05/05/2025 00:43:53.775 7f907758eb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.775 7f907758eb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:43:53.775 7f907758eb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:53.788 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:43:54.761 7f9085436e88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 05/05/2025 00:43:54.775 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:43:54.810 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:43:55.862 7f9085436e88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 05/05/2025 00:43:55.866 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:43:55.866 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 05/05/2025 00:43:55.946 7f9085436e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 05/05/2025 00:43:55.954 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:43:56.878 7f9085436e88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 05/05/2025 00:43:56.882 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:43:56.889 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:43:57.716 7f90773a2588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:43:57.717 7f90773a2588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:43:57.717 7f90773a2588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:43:57.717 7f90773a2588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:57.717 7f90773a2588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:43:57.717 7f90773a2588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:43:57.717 7f90773a2588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:43:57.718 7f90773a2588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:43:57.718 7f90773a2588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:57.718 7f90773a2588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:43:57.718 7f90773a2588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:57.718 7f90773a2588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:57.718 7f90773a2588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:43:57.718 7f90773a2588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:43:57.987 7f9085436e88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 05/05/2025 00:43:57.991 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:43:58.002 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:43:58.384 7f9085436e88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 05/05/2025 00:43:58.387 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:43:58.393 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:43:58.885 7f9085436e88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 05/05/2025 00:43:58.890 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:43:58.895 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:43:59.445 7f9085436e88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 05/05/2025 00:43:59.454 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:43:59.461 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:44:00.345 7f9085436e88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 05/05/2025 00:44:00.349 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:44:00.354 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:44:00.867 7f9085436e88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 05/05/2025 00:44:00.870 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:44:00.875 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/05/2025 00:44:01.718 7f90773b4eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:44:01.719 7f90773b4eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:44:01.719 7f90773b4eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:44:01.719 7f90773b4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:44:01.720 7f90773b4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:01.972 7f9085436e88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 05/05/2025 00:44:01.977 7f9085436e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 05/05/2025 00:44:01.977 7f907758ecc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:01.978 7f907758ecc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:44:01.978 7f907758ecc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.012 7f9085436e88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.33:5673//', 'pyamqp://guest:guest@10.0.0.56:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//'] 05/05/2025 00:44:02.013 7f9085436e88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 05/05/2025 00:44:02.013 7f9077465ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.013 7f9077465ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 05/05/2025 00:44:02.013 7f9077465ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.013 7f9077465ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.014 7f9077465ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 05/05/2025 00:44:02.014 7f9077465ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.016 7f9085436e88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 05/05/2025 00:44:02.017 7f90773ca240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.017 7f90773ca240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:44:02.017 7f90773ca240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.054 7f9085436e88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 05/05/2025 00:44:02.055 7f907739f390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.055 7f907739f390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 05/05/2025 00:44:02.055 7f907739f390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.058 7f9085436e88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 05/05/2025 00:44:02.058 7f907739f828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.058 7f907739f828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:44:02.058 7f907739f828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.059 7f9077465ac8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 05/05/2025 00:44:02.060 7f90773ae240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.060 7f90773ae240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 05/05/2025 00:44:02.060 7f90773ae240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.063 7f9077465ac8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 05/05/2025 00:44:02.063 7f90773b8240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:02.063 7f90773b8240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:44:02.063 7f90773b8240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:05.720 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:44:05.721 7f9082dd1b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:44:05.721 7f9082dd1b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:44:05.721 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:44:05.722 7f9082dd1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:09.722 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:44:09.723 7f9082dd1b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:44:09.723 7f9082dd1b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:44:09.723 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:09.723 7f9082dd1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:44:09.723 7f9082dd1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:09.723 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:44:09.723 7f9082dd1b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:44:09.723 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:09.724 7f9082dd1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:44:09.724 7f9082dd1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:09.724 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:09.724 7f9082dd1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:44:09.724 7f9082dd1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:13.724 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:44:13.725 7f9082dd1b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 05/05/2025 00:44:13.725 7f9082dd1b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:44:13.725 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:13.725 7f9082dd1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:44:13.725 7f9082dd1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:13.725 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/05/2025 00:44:13.725 7f9082dd1b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/05/2025 00:44:13.726 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:13.726 7f9082dd1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/05/2025 00:44:13.726 7f9082dd1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:13.726 7f9082dd1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:13.726 7f9082dd1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1746405741664497 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.33:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/05/2025 00:44:13.726 7f9082dd1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/05/2025 00:44:17.150 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.56', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3262-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-2.'], 'id_perms': {'created': '2025-05-05T00:44:17.141450', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:44:17.141450', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13717347922654873751, 'uuid_mslong': 11424658947429124230}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9e8c8ac8-4180-4886-be5d-cf420e494897'}, 'oper': 'CREATE', 'request-id': 'req-2dc5026e-10d5-4243-b97b-7d9c230f6757', 'type': 'analytics_node', 'uuid': '9e8c8ac8-4180-4886-be5d-cf420e494897'} 05/05/2025 00:44:17.193 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3262-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-1.'], 'id_perms': {'created': '2025-05-05T00:44:17.185644', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:44:17.185644', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13790944765484674149, 'uuid_mslong': 8107996061260663416}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '70856375-afb5-4a78-bf63-473257bf2c65'}, 'oper': 'CREATE', 'request-id': 'req-919d13ca-02f3-4780-82ee-d00d8d46b406', 'type': 'analytics_node', 'uuid': '70856375-afb5-4a78-bf63-473257bf2c65'} 05/05/2025 00:44:17.199 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3262-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-3.'], 'id_perms': {'created': '2025-05-05T00:44:17.187273', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:44:17.187273', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9907721208940635887, 'uuid_mslong': 8519912101707402700}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '763cceea-83d2-4dcc-897f-4bf23882a6ef'}, 'oper': 'CREATE', 'request-id': 'req-787567a0-ea90-4194-afa1-61590e5c47e1', 'type': 'analytics_node', 'uuid': '763cceea-83d2-4dcc-897f-4bf23882a6ef'} 05/05/2025 00:44:17.726 7f9077476f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/05/2025 00:44:17.727 7f9077476f60 [contrail-device-manager] [INFO]: Session Event: TCP Connected 05/05/2025 00:44:17.727 7f9077476f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/05/2025 00:44:17.727 7f9077476f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:17.727 7f9077476f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3262-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.33:5673, 10.0.0.56:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.33:9041, 10.0.0.56:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.33:2181, 10.0.0.56:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.33,10.0.0.56,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/05/2025 00:44:17.727 7f9077476f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/05/2025 00:44:17.727 7f9077476f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 05/05/2025 00:44:17.728 7f9077476f60 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 05/05/2025 00:44:17.728 7f9077476f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 05/05/2025 00:44:17.728 7f9077476f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/05/2025 00:44:17.728 7f9077476f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/05/2025 00:44:17.728 7f907741b4e0 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/05/2025 00:44:17.729 7f907741b4e0 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/05/2025 00:44:27.309 7f907741b438 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001017 05/05/2025 00:44:27.309 7f907741b438 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/05/2025 00:44:27.309 7f907f1f6ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 05/05/2025 00:44:27.310 7f907f1f6ac8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 05/05/2025 00:44:27.310 7f907f1f6ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/05/2025 00:44:27.310 7f907f1f6ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/05/2025 00:44:27.310 7f907f1f6ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 05/05/2025 00:44:27.310 7f907d6114e0 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/05/2025 00:44:27.311 7f907d6114e0 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/05/2025 00:44:30.682 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3262-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-1.'], 'id_perms': {'created': '2025-05-05T00:44:30.660671', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:44:30.660671', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11414758978410714284, 'uuid_mslong': 5535658482137648495}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4cd29c0f-71b1-4d6f-9e69-5ed018df14ac'}, 'oper': 'CREATE', 'request-id': 'req-64ef47d8-f7d8-4ff6-b257-0cb039504259', 'type': 'analytics_alarm_node', 'uuid': '4cd29c0f-71b1-4d6f-9e69-5ed018df14ac'} 05/05/2025 00:44:31.351 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.56', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3262-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-2.'], 'id_perms': {'created': '2025-05-05T00:44:31.331213', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:44:31.331213', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11819352882545052074, 'uuid_mslong': 13949372657640490382}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c1962086-7235-458e-a406-c6d3371649aa'}, 'oper': 'CREATE', 'request-id': 'req-62c26e8a-dc10-47a9-ae0e-9b84c61d4d5b', 'type': 'analytics_alarm_node', 'uuid': 'c1962086-7235-458e-a406-c6d3371649aa'} 05/05/2025 00:44:31.396 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3262-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-3.'], 'id_perms': {'created': '2025-05-05T00:44:31.377931', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:44:31.377931', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9694645516212509069, 'uuid_mslong': 8710227292173781411}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '78e0f192-ceee-49a3-868a-4cbb892e198d'}, 'oper': 'CREATE', 'request-id': 'req-fceda90f-7cf1-42fd-9c06-573a63ba1628', 'type': 'analytics_alarm_node', 'uuid': '78e0f192-ceee-49a3-868a-4cbb892e198d'} 05/05/2025 00:44:37.173 7f907741b438 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 05/05/2025 00:44:37.254 7f907741b438 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/05/2025 00:44:37.255 7f90774e8d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 05/05/2025 00:44:37.255 7f90774e8d68 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 05/05/2025 00:44:37.255 7f90774e8d68 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/05/2025 00:44:37.255 7f90774e8d68 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/05/2025 00:44:40.052 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.56', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3262-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-2.'], 'id_perms': {'created': '2025-05-05T00:44:40.041196', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:44:40.041196', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13447979379409303447, 'uuid_mslong': 2115894808811817819}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1d5d2b1e-3d52-4b5b-baa0-d1fec0783797'}, 'oper': 'CREATE', 'request-id': 'req-0505700f-b8e4-493a-9edc-42d2c0f95694', 'type': 'analytics_snmp_node', 'uuid': '1d5d2b1e-3d52-4b5b-baa0-d1fec0783797'} 05/05/2025 00:44:40.066 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3262-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-3.'], 'id_perms': {'created': '2025-05-05T00:44:40.057376', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:44:40.057376', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12405199442285938023, 'uuid_mslong': 12041263608772120110}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a71b2974-6fb3-4e2e-ac28-1f2acd53c567'}, 'oper': 'CREATE', 'request-id': 'req-64f4ac8a-b5cc-446b-b94f-8d98cb5bf4f3', 'type': 'analytics_snmp_node', 'uuid': 'a71b2974-6fb3-4e2e-ac28-1f2acd53c567'} 05/05/2025 00:44:40.114 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3262-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3262-1.'], 'id_perms': {'created': '2025-05-05T00:44:40.099654', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:44:40.099654', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9693183689189618247, 'uuid_mslong': 6589736855003809794}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5b7372c1-75cd-4802-8685-1b3568c1f247'}, 'oper': 'CREATE', 'request-id': 'req-13f34d73-40a1-4e20-ba03-8553fa65f6be', 'type': 'analytics_snmp_node', 'uuid': '5b7372c1-75cd-4802-8685-1b3568c1f247'} 05/05/2025 00:46:21.377 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-90a01e44-911a-4b10-a750-fe7ab11c6540', 'type': 'global_system_config', 'uuid': '68817aac-62bd-4847-913f-7340405f55e1'} 05/05/2025 00:46:21.512 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3262-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-1'], 'id_perms': {'created': '2025-05-05T00:46:21.500510', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:46:21.500510', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13239751703268826638, 'uuid_mslong': 12669415700854423824}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'afd2ce74-592f-4110-b7bd-0c06e3b61e0e', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-4c55aa00-2242-448c-b59d-f97713e28543', 'type': 'virtual_router', 'uuid': 'afd2ce74-592f-4110-b7bd-0c06e3b61e0e'} 05/05/2025 00:46:21.837 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-1', 'vhost0'], 'id_perms': {'created': '2025-05-05T00:46:21.824654', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:46:21.824654', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11475806715784410296, 'uuid_mslong': 7530263757317423671}}, 'parent_type': 'virtual-router', 'parent_uuid': 'afd2ce74-592f-4110-b7bd-0c06e3b61e0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6880defd-7fe7-4237-9f42-4168155f34b8', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:68:80:de:fd:7f']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'caf4ab3e-01c7-46f7-b3f5-1c21e2091fb8'}]}, 'oper': 'CREATE', 'request-id': 'req-912c5389-66c6-4f55-b5bc-aa14cb47c319', 'type': 'virtual_machine_interface', 'uuid': '6880defd-7fe7-4237-9f42-4168155f34b8'} 05/05/2025 00:46:21.881 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-912c5389-66c6-4f55-b5bc-aa14cb47c319', 'type': 'virtual_machine_interface', 'uuid': '6880defd-7fe7-4237-9f42-4168155f34b8'} 05/05/2025 00:46:21.922 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3262-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-2'], 'id_perms': {'created': '2025-05-05T00:46:21.913271', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:46:21.913271', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11613804488670380737, 'uuid_mslong': 5063865834552639562}}, 'parent_type': 'global-system-config', 'parent_uuid': '68817aac-62bd-4847-913f-7340405f55e1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '46467725-a2bf-404a-a12c-85a65e0902c1', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-4ec680ba-ab07-446c-955a-0356722972e9', 'type': 'virtual_router', 'uuid': '46467725-a2bf-404a-a12c-85a65e0902c1'} 05/05/2025 00:46:22.276 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-2', 'vhost0'], 'id_perms': {'created': '2025-05-05T00:46:22.261375', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-05T00:46:22.261375', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12639992405354544835, 'uuid_mslong': 8864717387556145967}}, 'parent_type': 'virtual-router', 'parent_uuid': '46467725-a2bf-404a-a12c-85a65e0902c1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7b05cd7f-2783-4b2f-af6a-461f84cafec3', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:7b:05:cd:7f:27']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'caf4ab3e-01c7-46f7-b3f5-1c21e2091fb8'}]}, 'oper': 'CREATE', 'request-id': 'req-7ca00a94-e2b2-4729-9973-ef64fa3a5937', 'type': 'virtual_machine_interface', 'uuid': '7b05cd7f-2783-4b2f-af6a-461f84cafec3'} 05/05/2025 00:46:22.319 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3262-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-7ca00a94-e2b2-4729-9973-ef64fa3a5937', 'type': 'virtual_machine_interface', 'uuid': '7b05cd7f-2783-4b2f-af6a-461f84cafec3'} 05/05/2025 00:46:22.372 7f907739fc18 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-122455c5-df9c-4d45-a42e-ff62eaf8caee', 'type': 'access_control_list', 'uuid': '54a35bb3-3025-4dd1-9a22-b1d8e8aef1eb'} 05/05/2025 00:47:10.529 7f907d6262e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/05/2025 00:47:21.017 7f907d6262e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/05/2025 01:34:13.366 7f90773bb0f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map