09/08/2025 05:18:39.135 7fc8cd449fc8 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/08/2025 05:18:39.135 7fc8cd449fc8 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/08/2025 05:18:39.135 7fc8cd449fc8 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/08/2025 05:18:39.136 7fc8c4b2b2e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 09/08/2025 05:18:39.136 7fc8c4b2b2e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 09/08/2025 05:18:39.136 7fc8c4b2b2e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/08/2025 05:18:39.136 7fc8c4b2b2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/08/2025 05:18:39.137 7fc8c4b2b2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.137 7fc8c4b2b2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/08/2025 05:18:39.137 7fc8c4b2b2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.137 7fc8c4b2b2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.137 7fc8c4b2b2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1757308719136793 collector_name = collector_ip = collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/08/2025 05:18:39.137 7fc8c4b2b2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.184 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//'] 09/08/2025 05:18:39.193 7fc8cd449fc8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 09/08/2025 05:18:39.193 7fc8c4a7b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.193 7fc8c4a7b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 09/08/2025 05:18:39.193 7fc8c4a7b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.194 7fc8c4a7b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.194 7fc8c4a7b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 09/08/2025 05:18:39.194 7fc8c4a7b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.197 7fc8cd449fc8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/08/2025 05:18:39.197 7fc8c4a7b240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.198 7fc8c4a7b240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/08/2025 05:18:39.198 7fc8c4a7b240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.237 7fc8cd449fc8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 09/08/2025 05:18:39.238 7fc8c4a7b0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.238 7fc8c4a7b0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 09/08/2025 05:18:39.238 7fc8c4a7b0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.241 7fc8cd449fc8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 09/08/2025 05:18:39.241 7fc8d332d978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.241 7fc8d332d978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/08/2025 05:18:39.241 7fc8d332d978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.276 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 09/08/2025 05:18:39.276 7fc8cd449fc8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 09/08/2025 05:18:39.276 7fc8cd449fc8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 09/08/2025 05:18:39.277 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 09/08/2025 05:18:39.277 7fc8ca3b36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 09/08/2025 05:18:39.277 7fc8ca3b36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 09/08/2025 05:18:39.277 7fc8c72c7978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 09/08/2025 05:18:39.277 7fc8c72c7978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 09/08/2025 05:18:39.277 7fc8c4a3c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.278 7fc8c4a3c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:18:39.278 7fc8c4a3c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.279 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 09/08/2025 05:18:39.281 7fc8c72c7978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 09/08/2025 05:18:39.282 7fc8ca3b36d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 09/08/2025 05:18:39.282 7fc8ca3b36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 09/08/2025 05:18:39.318 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 09/08/2025 05:18:39.320 7fc8c48ce588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.320 7fc8c48ce588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 09/08/2025 05:18:39.320 7fc8c48ce588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.328 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 09/08/2025 05:18:39.329 7fc8c47fbcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.329 7fc8c47fbcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:18:39.329 7fc8c47fbcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:39.341 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 09/08/2025 05:18:39.366 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 09/08/2025 05:18:41.260 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:18:42.032 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 09/08/2025 05:18:42.039 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:18:43.138 7fc8c4833588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:18:43.139 7fc8c4833588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:18:43.139 7fc8c4833588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:18:43.139 7fc8c4833588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:43.139 7fc8c4833588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:18:43.140 7fc8c4833588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:43.140 7fc8c4833588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:18:43.140 7fc8c4833588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:18:43.140 7fc8c4833588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:43.140 7fc8c4833588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:18:43.140 7fc8c4833588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:43.140 7fc8c4833588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:43.140 7fc8c4833588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:18:43.140 7fc8c4833588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:43.212 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:18:44.094 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 09/08/2025 05:18:44.100 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:18:45.974 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:18:47.020 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 09/08/2025 05:18:47.026 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:18:47.140 7fc8c905ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:18:47.141 7fc8c905ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:18:47.141 7fc8c905ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:18:47.141 7fc8c905ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:18:47.142 7fc8c905ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:49.104 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:18:50.000 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 09/08/2025 05:18:50.007 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:18:51.142 7fc8c4831ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:18:51.143 7fc8c4831ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:18:51.143 7fc8c4831ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:18:51.143 7fc8c4831ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:18:51.144 7fc8c4831ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:52.130 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:18:52.132 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 09/08/2025 05:18:52.138 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:18:54.145 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:18:54.910 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 09/08/2025 05:18:54.918 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:18:54.919 7fc8c5664438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:54.919 7fc8c5664438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:18:54.919 7fc8c5664438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:54.952 7fc8cd449fc8 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 09/08/2025 05:18:54.953 7fc8c47aa048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:54.953 7fc8c47aa048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 09/08/2025 05:18:54.954 7fc8c47aa048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:54.966 7fc8c4826d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:54.966 7fc8c4826d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:18:54.967 7fc8c4826d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:54.967 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 09/08/2025 05:18:54.967 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 09/08/2025 05:18:54.967 7fc8ca3b36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 09/08/2025 05:18:54.968 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4042-2. 09/08/2025 05:18:54.980 7fc8ca3b36d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 09/08/2025 05:18:55.119 7fc8ca3b36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4042-2.'] 09/08/2025 05:18:55.144 7fc8c4826780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:18:55.145 7fc8c4826780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:18:55.146 7fc8c4826780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:18:55.146 7fc8c4826780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:55.146 7fc8c4826780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:18:55.146 7fc8c4826780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:55.146 7fc8c4826780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:18:55.146 7fc8c4826780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:18:55.146 7fc8c4826780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:55.146 7fc8c4826780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:18:55.147 7fc8c4826780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:55.147 7fc8c4826780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:55.147 7fc8c4826780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:18:55.147 7fc8c4826780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:55.147 7fc8ca3b36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 09/08/2025 05:18:55.161 7fc8ca3b36d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 09/08/2025 05:18:55.227 7fc8ca3b36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4042-2.'] 09/08/2025 05:18:55.480 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Fetching all containers 09/08/2025 05:18:55.526 7fc8cd449fc8 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 09/08/2025 05:18:55.696 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4042-2..config_queue 09/08/2025 05:18:55.697 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4042-2..tftp_queue 09/08/2025 05:18:56.198 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode... 09/08/2025 05:18:56.198 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 09/08/2025 05:18:56.198 7fc8cd449fc8 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 09/08/2025 05:18:56.202 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 09/08/2025 05:18:56.202 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 09/08/2025 05:18:56.203 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 09/08/2025 05:18:56.203 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 09/08/2025 05:18:56.205 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 09/08/2025 05:18:56.205 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 09/08/2025 05:18:56.210 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 09/08/2025 05:18:56.210 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 09/08/2025 05:18:56.210 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 09/08/2025 05:18:56.210 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 09/08/2025 05:18:56.210 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 09/08/2025 05:18:56.210 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 09/08/2025 05:18:56.210 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 09/08/2025 05:18:56.211 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 09/08/2025 05:18:56.211 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 09/08/2025 05:18:56.211 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 09/08/2025 05:18:56.211 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 09/08/2025 05:18:56.211 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 09/08/2025 05:18:56.211 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 09/08/2025 05:18:56.213 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 09/08/2025 05:18:56.213 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 09/08/2025 05:18:56.213 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 09/08/2025 05:18:56.213 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 09/08/2025 05:18:56.214 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 09/08/2025 05:18:56.214 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 09/08/2025 05:18:56.214 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 09/08/2025 05:18:56.215 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 09/08/2025 05:18:56.215 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 09/08/2025 05:18:56.215 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 09/08/2025 05:18:56.215 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 09/08/2025 05:18:56.215 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 09/08/2025 05:18:56.215 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 09/08/2025 05:18:56.216 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 09/08/2025 05:18:56.217 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 09/08/2025 05:18:56.218 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 09/08/2025 05:18:56.218 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 09/08/2025 05:18:56.218 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 09/08/2025 05:18:56.221 7fc8cd449fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 09/08/2025 05:18:56.238 7fc8c475bc18 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 09/08/2025 05:18:56.238 7fc8c475bc18 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 09/08/2025 05:18:56.296 7fc8bf71bc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:56.297 7fc8bf71bc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 09/08/2025 05:18:56.297 7fc8bf71bc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:56.310 7fc8bf67c198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:56.310 7fc8bf67c198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 09/08/2025 05:18:56.310 7fc8bf67c198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:56.313 7fc8ca3b36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 09/08/2025 05:18:56.317 7fc8ca3b36d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 09/08/2025 05:18:56.459 7fc8ca3b36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4042-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4042-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4042-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 09/08/2025 05:18:59.146 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:18:59.148 7fc8bf60ceb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:18:59.148 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:18:59.148 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:59.148 7fc8bf60ceb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 09/08/2025 05:18:59.148 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:18:59.148 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:18:59.149 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:18:59.149 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:59.149 7fc8bf60ceb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 09/08/2025 05:18:59.149 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:59.149 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:18:59.149 7fc8bf60ceb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:18:59.149 7fc8bf60ceb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:02.449 7fc8bf5aed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:02.449 7fc8bf5aed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:02.449 7fc8bf5aed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:03.149 7fc8bf52c588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:03.150 7fc8bf52c588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:03.150 7fc8bf52c588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:03.150 7fc8bf52c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:03.150 7fc8bf52c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:03.150 7fc8bf52c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:03.150 7fc8bf52c588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:03.151 7fc8bf52c588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:03.151 7fc8bf52c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:03.151 7fc8bf52c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:03.151 7fc8bf52c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:03.151 7fc8bf52c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:03.151 7fc8bf52c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:03.151 7fc8bf52c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:07.151 7fc8bf56b828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:07.152 7fc8bf56b828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:07.152 7fc8bf56b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:07.152 7fc8bf56b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:07.152 7fc8bf56b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:07.152 7fc8bf56b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:07.153 7fc8bf56b828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:07.153 7fc8bf56b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:07.153 7fc8bf56b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:07.153 7fc8bf56b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:07.153 7fc8bf56b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:07.153 7fc8bf56b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:07.153 7fc8bf56b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:07.153 7fc8bf56b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:11.153 7fc8bf4c9978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:11.154 7fc8bf4c9978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:11.154 7fc8bf4c9978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:11.154 7fc8bf4c9978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:11.155 7fc8bf4c9978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:15.155 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:15.156 7fc8bf525f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:15.157 7fc8bf525f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:15.157 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:15.157 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:15.157 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:15.157 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:15.157 7fc8bf525f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:15.157 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:15.157 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:15.157 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:15.158 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:15.158 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:15.158 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:19.158 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:19.159 7fc8bf525f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:19.160 7fc8bf525f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:19.160 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:19.160 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:19.160 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:19.160 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:19.160 7fc8bf525f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:19.160 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:19.160 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:19.161 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:19.161 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:19.161 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:19.161 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:23.160 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:23.162 7fc8bf525f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:23.162 7fc8bf525f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:23.162 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:23.162 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:23.162 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:23.162 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:23.163 7fc8bf525f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:23.163 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:23.163 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:23.163 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:23.163 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:23.163 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:23.163 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:27.163 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:27.165 7fc8bf525f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:27.165 7fc8bf525f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:27.165 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:27.165 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:27.165 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:27.165 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:27.165 7fc8bf525f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:27.165 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:27.166 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:27.166 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:27.166 7fc8bf525f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:27.166 7fc8bf525f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:27.166 7fc8bf525f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:31.166 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:31.168 7fc8bf671048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:31.168 7fc8bf671048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:31.168 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:31.169 7fc8bf671048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:31.169 7fc8bf671048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:31.169 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:31.169 7fc8bf671048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:31.169 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:31.170 7fc8bf671048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:31.170 7fc8bf671048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:31.170 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:31.170 7fc8bf671048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:31.170 7fc8bf671048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:35.169 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:35.170 7fc8bf671048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:35.171 7fc8bf671048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:35.171 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:35.171 7fc8bf671048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:35.171 7fc8bf671048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:35.171 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:35.172 7fc8bf671048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:35.172 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:35.172 7fc8bf671048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:35.172 7fc8bf671048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:35.172 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:35.172 7fc8bf671048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:35.172 7fc8bf671048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:39.172 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:39.173 7fc8bf671048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:39.173 7fc8bf671048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:39.173 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:39.173 7fc8bf671048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:39.173 7fc8bf671048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:39.174 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:39.174 7fc8bf671048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:39.174 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:39.174 7fc8bf671048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:39.174 7fc8bf671048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:39.174 7fc8bf671048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:39.174 7fc8bf671048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:39.174 7fc8bf671048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:43.175 7fc8c48310f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:43.176 7fc8c48310f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:43.176 7fc8c48310f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:43.176 7fc8c48310f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:43.176 7fc8c48310f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:43.176 7fc8c48310f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:43.176 7fc8c48310f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:43.177 7fc8c48310f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:43.177 7fc8c48310f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:43.177 7fc8c48310f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:43.177 7fc8c48310f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:43.177 7fc8c48310f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:43.177 7fc8c48310f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:43.177 7fc8c48310f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:47.176 7fc8c4a77780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:47.177 7fc8c4a77780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:47.178 7fc8c4a77780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:47.179 7fc8c4a77780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:47.179 7fc8c4a77780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:51.179 7fc8bf4d8588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:51.179 7fc8bf4d8588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:51.180 7fc8bf4d8588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:51.180 7fc8bf4d8588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:51.180 7fc8bf4d8588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:51.180 7fc8bf4d8588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:51.180 7fc8bf4d8588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:51.180 7fc8bf4d8588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:51.180 7fc8bf4d8588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:51.180 7fc8bf4d8588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:51.181 7fc8bf4d8588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:51.181 7fc8bf4d8588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:51.181 7fc8bf4d8588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:51.181 7fc8bf4d8588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:55.180 7fc8c4826cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:55.181 7fc8c4826cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:55.181 7fc8c4826cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:55.181 7fc8c4826cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:55.181 7fc8c4826cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:55.181 7fc8c4826cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:55.182 7fc8c4826cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:55.182 7fc8c4826cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:55.182 7fc8c4826cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:55.182 7fc8c4826cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:55.182 7fc8c4826cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:55.182 7fc8c4826cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:55.182 7fc8c4826cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:55.182 7fc8c4826cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:59.182 7fc8bf52fa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:19:59.184 7fc8bf52fa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:19:59.184 7fc8bf52fa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:19:59.185 7fc8bf52fa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:19:59.186 7fc8bf52fa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:03.185 7fc8ca524240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:03.186 7fc8ca524240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:03.186 7fc8ca524240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:03.186 7fc8ca524240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:03.186 7fc8ca524240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:03.186 7fc8ca524240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:03.186 7fc8ca524240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:03.186 7fc8ca524240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:03.186 7fc8ca524240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:03.186 7fc8ca524240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:03.187 7fc8ca524240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:03.187 7fc8ca524240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:03.187 7fc8ca524240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:03.187 7fc8ca524240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:07.187 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:07.188 7fc8bf52f6d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:07.188 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:07.188 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:07.188 7fc8bf52f6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:07.188 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:07.188 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:07.189 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:07.189 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:07.189 7fc8bf52f6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:07.189 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:07.189 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:07.189 7fc8bf52f6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:07.189 7fc8bf52f6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:11.188 7fc8c4a6f438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:11.189 7fc8c4a6f438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:11.190 7fc8c4a6f438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:11.190 7fc8c4a6f438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:11.190 7fc8c4a6f438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:11.190 7fc8c4a6f438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:11.190 7fc8c4a6f438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:11.190 7fc8c4a6f438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:11.190 7fc8c4a6f438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:11.190 7fc8c4a6f438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:11.191 7fc8c4a6f438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:11.191 7fc8c4a6f438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:11.191 7fc8c4a6f438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:11.191 7fc8c4a6f438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:15.190 7fc8bf52fb70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:15.191 7fc8bf52fb70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:15.191 7fc8bf52fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:15.191 7fc8bf52fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:15.192 7fc8bf52fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:18.806 7fc8cd449fc8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 09/08/2025 05:20:18.807 7fc8cd449fc8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 09/08/2025 05:20:18.807 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 09/08/2025 05:20:18.807 7fc8c4a77780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:18.807 7fc8c4a77780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:20:18.807 7fc8c4a77780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:18.808 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 09/08/2025 05:20:18.844 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 09/08/2025 05:20:18.847 7fc8bf50a0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:18.847 7fc8bf50a0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 09/08/2025 05:20:18.847 7fc8bf50a0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:18.861 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 09/08/2025 05:20:18.861 7fc8bf6e0eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:18.862 7fc8bf6e0eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:20:18.862 7fc8bf6e0eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:18.879 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:19.192 7fc8bf5070f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:19.194 7fc8bf5070f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:19.194 7fc8bf5070f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:19.194 7fc8bf5070f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:19.194 7fc8bf5070f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:20:19.195 7fc8bf5070f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:19.195 7fc8bf5070f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:19.195 7fc8bf5070f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:19.195 7fc8bf5070f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:19.195 7fc8bf5070f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:20:19.195 7fc8bf5070f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:19.195 7fc8bf5070f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:19.195 7fc8bf5070f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:19.195 7fc8bf5070f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:19.777 7fc8cd449fc8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 09/08/2025 05:20:19.798 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:19.821 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:21.256 7fc8cd449fc8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 09/08/2025 05:20:21.261 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:21.261 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 09/08/2025 05:20:21.337 7fc8cd449fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 09/08/2025 05:20:21.347 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:22.222 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 09/08/2025 05:20:22.228 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:22.238 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:23.130 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 09/08/2025 05:20:23.136 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:23.151 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:23.195 7fc8bf50a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:23.196 7fc8bf50a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:23.196 7fc8bf50a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:23.196 7fc8bf50a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:23.197 7fc8bf50a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:23.992 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 09/08/2025 05:20:23.997 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:24.003 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:24.940 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 09/08/2025 05:20:24.946 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:24.956 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:25.723 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 09/08/2025 05:20:25.730 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:25.736 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:26.281 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 09/08/2025 05:20:26.285 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:26.294 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:26.905 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 09/08/2025 05:20:26.909 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:26.915 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/08/2025 05:20:27.197 7fc8bf505048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:27.198 7fc8bf505048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:27.198 7fc8bf505048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:27.198 7fc8bf505048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:27.198 7fc8bf505048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:20:27.198 7fc8bf505048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:27.198 7fc8bf505048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:27.199 7fc8bf505048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:27.199 7fc8bf505048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.199 7fc8bf505048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/08/2025 05:20:27.199 7fc8bf505048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.199 7fc8bf505048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.199 7fc8bf505048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:27.199 7fc8bf505048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.808 7fc8cd449fc8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 09/08/2025 05:20:27.815 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 09/08/2025 05:20:27.815 7fc8bf5fb4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.815 7fc8bf5fb4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:27.815 7fc8bf5fb4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.858 7fc8cd449fc8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//'] 09/08/2025 05:20:27.858 7fc8cd449fc8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 09/08/2025 05:20:27.859 7fc8bf4c9588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.859 7fc8bf4c9588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/08/2025 05:20:27.859 7fc8bf4c9588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.859 7fc8bf4c9588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.859 7fc8bf4c9588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/08/2025 05:20:27.859 7fc8bf4c9588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.862 7fc8cd449fc8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/08/2025 05:20:27.862 7fc8bf56beb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.863 7fc8bf56beb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:27.863 7fc8bf56beb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.898 7fc8cd449fc8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 09/08/2025 05:20:27.899 7fc8bf4a0eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.899 7fc8bf4a0eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/08/2025 05:20:27.899 7fc8bf4a0eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.902 7fc8cd449fc8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 09/08/2025 05:20:27.902 7fc8bf4a02e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.903 7fc8bf4a02e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:27.903 7fc8bf4a02e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.904 7fc8bf693438 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 09/08/2025 05:20:27.904 7fc8bf49acc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.904 7fc8bf49acc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/08/2025 05:20:27.905 7fc8bf49acc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.908 7fc8bf693438 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 09/08/2025 05:20:27.908 7fc8bf4abb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:27.908 7fc8bf4abb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:27.908 7fc8bf4abb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:31.198 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:31.199 7fc8bf4a4588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:31.200 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:31.200 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:31.200 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:31.200 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:31.200 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:31.200 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:31.200 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:31.201 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:31.201 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:31.201 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:31.201 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:31.201 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:35.200 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:35.202 7fc8bf4a4588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:35.202 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:35.202 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:35.202 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:35.202 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:35.202 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:35.203 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:35.203 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:35.203 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:35.203 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:35.203 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:35.203 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:35.203 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:39.203 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:39.205 7fc8bf4a4588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:39.205 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:39.205 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:39.205 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:39.206 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:39.206 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:39.206 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:39.206 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:39.206 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:39.207 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:39.207 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:39.207 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:39.207 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:43.206 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:43.207 7fc8bf4a4588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:43.208 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:43.208 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:43.208 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:43.208 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:43.208 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:43.208 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:43.208 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:43.209 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:43.209 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:43.209 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:43.209 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:43.209 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:47.209 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:47.210 7fc8bf4a4588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:47.211 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:47.211 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:47.211 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:47.211 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:47.211 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:47.211 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:47.211 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:47.211 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:47.211 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:47.212 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:47.212 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:47.212 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:51.212 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:51.213 7fc8bf4a4588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 09/08/2025 05:20:51.213 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:51.213 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:51.213 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:51.213 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:51.213 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/08/2025 05:20:51.214 7fc8bf4a4588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/08/2025 05:20:51.214 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:51.214 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/08/2025 05:20:51.214 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:51.214 7fc8bf4a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:51.214 7fc8bf4a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1757308719136793 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/08/2025 05:20:51.214 7fc8bf4a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/08/2025 05:20:53.391 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4042-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-2.'], 'id_perms': {'created': '2025-09-08T05:20:53.364185', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:20:53.364185', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11363714340162887167, 'uuid_mslong': 7605564595223413804}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '698c64b4-0e94-442c-9db4-05fc1e6bddff'}, 'oper': 'CREATE', 'request-id': 'req-250a59d6-fb52-4aa6-a258-e35de3e8ef3c', 'type': 'analytics_node', 'uuid': '698c64b4-0e94-442c-9db4-05fc1e6bddff'} 09/08/2025 05:20:53.919 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4042-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-3.'], 'id_perms': {'created': '2025-09-08T05:20:53.909722', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:20:53.909722', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13234589879410665423, 'uuid_mslong': 7799830500408443487}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6c3e9083-cd1a-425f-b7aa-b5601e40a7cf'}, 'oper': 'CREATE', 'request-id': 'req-25b29933-1981-442b-b8a5-b45ee5d17de9', 'type': 'analytics_node', 'uuid': '6c3e9083-cd1a-425f-b7aa-b5601e40a7cf'} 09/08/2025 05:20:53.943 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4042-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-1.'], 'id_perms': {'created': '2025-09-08T05:20:53.929842', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:20:53.929842', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13516397010382605239, 'uuid_mslong': 11603472043942757497}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a107d058-9c62-4479-bb93-e377cf01cbb7'}, 'oper': 'CREATE', 'request-id': 'req-57843eef-88b3-400d-9a50-91cacac90bc2', 'type': 'analytics_node', 'uuid': 'a107d058-9c62-4479-bb93-e377cf01cbb7'} 09/08/2025 05:20:55.214 7fc8bf4ab780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/08/2025 05:20:55.215 7fc8bf4ab780 [contrail-device-manager] [INFO]: Session Event: TCP Connected 09/08/2025 05:20:55.216 7fc8bf4ab780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/08/2025 05:20:55.216 7fc8bf4ab780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:55.217 7fc8bf4ab780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4042-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/08/2025 05:20:55.217 7fc8bf4ab780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/08/2025 05:20:55.217 7fc8bf4ab780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/08/2025 05:20:55.217 7fc8bf4ab780 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 09/08/2025 05:20:55.218 7fc8bf4ab780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/08/2025 05:20:55.218 7fc8bf4ab780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/08/2025 05:20:55.218 7fc8bf4ab780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/08/2025 05:20:55.219 7fc8bf48ab70 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/08/2025 05:20:55.220 7fc8bf48ab70 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/08/2025 05:21:03.656 7fc8bf691198 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 09/08/2025 05:21:03.657 7fc8bf691198 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/08/2025 05:21:03.657 7fc8bf4ab780 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 09/08/2025 05:21:03.657 7fc8bf4ab780 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 09/08/2025 05:21:03.657 7fc8bf4ab780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/08/2025 05:21:03.657 7fc8bf4ab780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/08/2025 05:21:03.658 7fc8bf4ab780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 09/08/2025 05:21:03.658 7fc8c48266d8 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/08/2025 05:21:03.659 7fc8c48266d8 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/08/2025 05:21:09.990 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4042-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-1.'], 'id_perms': {'created': '2025-09-08T05:21:09.967821', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:21:09.967821', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10443003262468979531, 'uuid_mslong': 15352516607253561706}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd50f1883-5fa2-416a-90ed-002347b57b4b'}, 'oper': 'CREATE', 'request-id': 'req-2319320a-dd24-41e7-8423-a5a3c7fc47db', 'type': 'analytics_alarm_node', 'uuid': 'd50f1883-5fa2-416a-90ed-002347b57b4b'} 09/08/2025 05:21:10.129 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4042-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-2.'], 'id_perms': {'created': '2025-09-08T05:21:10.119327', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:21:10.119327', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12737131136775269086, 'uuid_mslong': 5688171328001756182}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4ef071af-831b-4c16-b0c3-6148e10eaade'}, 'oper': 'CREATE', 'request-id': 'req-4b72f52c-87ed-47e0-bd9e-4b03997298a5', 'type': 'analytics_alarm_node', 'uuid': '4ef071af-831b-4c16-b0c3-6148e10eaade'} 09/08/2025 05:21:10.739 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4042-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-3.'], 'id_perms': {'created': '2025-09-08T05:21:10.720528', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:21:10.720528', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11631649949394301745, 'uuid_mslong': 10358769069242010152}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8fc1bd95-da79-4a28-a16b-ec0079567331'}, 'oper': 'CREATE', 'request-id': 'req-504ef4f2-c9f4-4c15-992f-0b33274a5bd8', 'type': 'analytics_alarm_node', 'uuid': '8fc1bd95-da79-4a28-a16b-ec0079567331'} 09/08/2025 05:21:16.206 7fc8bf691198 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 09/08/2025 05:21:16.207 7fc8bf691198 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/08/2025 05:21:16.207 7fc8bf505f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 09/08/2025 05:21:16.207 7fc8bf505f60 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 09/08/2025 05:21:16.207 7fc8bf505f60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/08/2025 05:21:16.207 7fc8bf505f60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/08/2025 05:21:20.977 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4042-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-2.'], 'id_perms': {'created': '2025-09-08T05:21:20.963376', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:21:20.963376', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10487639748580365207, 'uuid_mslong': 9438116909035636597}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '82faed52-cfad-4775-918b-94c912665397'}, 'oper': 'CREATE', 'request-id': 'req-26ca4d7d-7c62-4c33-a5ba-cd02a3fd3a16', 'type': 'analytics_snmp_node', 'uuid': '82faed52-cfad-4775-918b-94c912665397'} 09/08/2025 05:21:21.079 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4042-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-3.'], 'id_perms': {'created': '2025-09-08T05:21:21.062539', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:21:21.062539', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10208556556920463174, 'uuid_mslong': 4255018984432551552}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3b0cdd38-e7a5-4680-8dac-1419ecba9f46'}, 'oper': 'CREATE', 'request-id': 'req-24d77d65-4d0c-477d-8dce-adbbff448f82', 'type': 'analytics_snmp_node', 'uuid': '3b0cdd38-e7a5-4680-8dac-1419ecba9f46'} 09/08/2025 05:21:21.101 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4042-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4042-1.'], 'id_perms': {'created': '2025-09-08T05:21:21.072258', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:21:21.072258', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13107060846616337421, 'uuid_mslong': 4268515590272601044}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3b3cd050-546a-4bd4-b5e5-a26553ff5c0d'}, 'oper': 'CREATE', 'request-id': 'req-61359122-1bb9-4991-bb05-f478d73322b7', 'type': 'analytics_snmp_node', 'uuid': '3b3cd050-546a-4bd4-b5e5-a26553ff5c0d'} 09/08/2025 05:23:00.604 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-7f465406-4b16-4675-9852-fb88cab63d1c', 'type': 'global_system_config', 'uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2'} 09/08/2025 05:23:00.741 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4042-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-1'], 'id_perms': {'created': '2025-09-08T05:23:00.725997', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:23:00.725997', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13764590469386737970, 'uuid_mslong': 6334615366637273155}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '57e9131d-1d25-4043-bf05-a61a9e861932', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-884a83e5-97dc-4c8b-8144-832c48f60603', 'type': 'virtual_router', 'uuid': '57e9131d-1d25-4043-bf05-a61a9e861932'} 09/08/2025 05:23:01.074 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-1', 'vhost0'], 'id_perms': {'created': '2025-09-08T05:23:01.057371', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:23:01.057371', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12183497424458477226, 'uuid_mslong': 2793550340785065475}}, 'parent_type': 'virtual-router', 'parent_uuid': '57e9131d-1d25-4043-bf05-a61a9e861932', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '26c4af3b-ecaa-4e03-a914-7a5b4abbeeaa', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:26:c4:af:3b:ec']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '9d960dd3-f94f-4c34-bd56-4e9896db557c'}]}, 'oper': 'CREATE', 'request-id': 'req-8b203925-50f1-4acb-96e9-09579405ec66', 'type': 'virtual_machine_interface', 'uuid': '26c4af3b-ecaa-4e03-a914-7a5b4abbeeaa'} 09/08/2025 05:23:01.131 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-8b203925-50f1-4acb-96e9-09579405ec66', 'type': 'virtual_machine_interface', 'uuid': '26c4af3b-ecaa-4e03-a914-7a5b4abbeeaa'} 09/08/2025 05:23:01.245 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4042-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-2'], 'id_perms': {'created': '2025-09-08T05:23:01.237728', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:23:01.237728', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10609892303450659929, 'uuid_mslong': 10849456635799490501}}, 'parent_type': 'global-system-config', 'parent_uuid': 'aade2247-ca0d-47c5-b320-cbc390f267b2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '96910353-ced5-4fc5-933d-e8d61c53dc59', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-0ac66f75-2d58-4298-84f8-bdb54943e8ae', 'type': 'virtual_router', 'uuid': '96910353-ced5-4fc5-933d-e8d61c53dc59'} 09/08/2025 05:23:01.591 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-2', 'vhost0'], 'id_perms': {'created': '2025-09-08T05:23:01.569342', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-08T05:23:01.569342', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10861444902519231081, 'uuid_mslong': 3801369799930498328}}, 'parent_type': 'virtual-router', 'parent_uuid': '96910353-ced5-4fc5-933d-e8d61c53dc59', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '34c12db1-48c1-4d18-96bb-9a97aa22d269', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:34:c1:2d:b1:48']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '9d960dd3-f94f-4c34-bd56-4e9896db557c'}]}, 'oper': 'CREATE', 'request-id': 'req-5f9a2a05-21bb-4414-bde0-5622043e6de4', 'type': 'virtual_machine_interface', 'uuid': '34c12db1-48c1-4d18-96bb-9a97aa22d269'} 09/08/2025 05:23:01.638 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-08ed9640-124b-4021-b76f-82de93b60d15', 'type': 'access_control_list', 'uuid': '231f80bb-d5e4-4fd5-ad3a-52cea52f287b'} 09/08/2025 05:23:01.667 7fc8bf56beb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4042-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-5f9a2a05-21bb-4414-bde0-5622043e6de4', 'type': 'virtual_machine_interface', 'uuid': '34c12db1-48c1-4d18-96bb-9a97aa22d269'} 09/08/2025 05:23:26.416 7fc8c4751b70 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/08/2025 05:23:56.003 7fc8bf4abb70 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/08/2025 05:25:17.326 7fc8c48b9c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map