03/24/2025 00:47:37.658 7f856f561e88 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/24/2025 00:47:37.658 7f856f561e88 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/24/2025 00:47:37.659 7f856f561e88 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/24/2025 00:47:37.659 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.23:2181,10.0.0.50:2181,10.0.0.57:2181 03/24/2025 00:47:37.659 7f856f561e88 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 00:47:37.660 7f85661d5f60 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 03/24/2025 00:47:37.660 7f85661d5f60 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 03/24/2025 00:47:37.660 7f85661da8d0 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 03/24/2025 00:47:37.660 7f85661da8d0 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777257660852 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 03/24/2025 00:47:37.661 7f85661da8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:37.671 7f85661fe4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:37.671 7f85661fe4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:47:37.671 7f85661fe4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:41.665 7f85659a8048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:41.666 7f85659a8048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:41.667 7f85659a8048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:41.667 7f85659a8048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:41.667 7f85659a8048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:41.667 7f85659a8048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:41.667 7f85659a8048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:41.668 7f85659a8048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:41.668 7f85659a8048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:41.668 7f85659a8048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:41.668 7f85659a8048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:41.668 7f85659a8048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:41.668 7f85659a8048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777257660852 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:41.668 7f85659a8048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:45.670 7f8565997b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:45.672 7f8565997b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:45.672 7f8565997b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:45.672 7f8565997b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:45.672 7f8565997b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:45.672 7f8565997b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:45.672 7f8565997b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:45.673 7f8565997b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:45.673 7f8565997b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:45.673 7f8565997b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:45.673 7f8565997b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:45.673 7f8565997b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:45.673 7f8565997b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777257660852 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:45.673 7f8565997b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:49.674 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:49.675 7f85661ebcc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:49.675 7f85661ebcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:49.675 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777257660852 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:49.676 7f85661ebcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:53.678 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:53.680 7f85661ebcc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:53.680 7f85661ebcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:53.680 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:53.680 7f85661ebcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:53.680 7f85661ebcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:53.680 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:53.680 7f85661ebcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:53.680 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:53.681 7f85661ebcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:53.681 7f85661ebcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:53.681 7f85661ebcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:53.681 7f85661ebcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777257660852 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:53.681 7f85661ebcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:55.866 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.23:9041', '10.0.0.50:9041', '10.0.0.57:9041'] 03/24/2025 00:47:55.866 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 03/24/2025 00:47:55.866 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/24/2025 00:47:55.866 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/24/2025 00:47:55.867 7f8565997eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:55.867 7f8565997eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:47:55.867 7f8565997eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:55.868 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/24/2025 00:47:55.913 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/24/2025 00:47:55.914 7f85659c6c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:55.914 7f85659c6c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:47:55.914 7f85659c6c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:55.922 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/24/2025 00:47:55.922 7f85659c6a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:55.922 7f85659c6a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:47:55.922 7f85659c6a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:55.935 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/24/2025 00:47:55.994 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/24/2025 00:47:55.994 7f8565997780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:55.995 7f8565997780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:55.995 7f8565997780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.119 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.23:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.57:5673//'] 03/24/2025 00:47:56.129 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 03/24/2025 00:47:56.130 7f8565772390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.130 7f8565772390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/24/2025 00:47:56.130 7f8565772390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.130 7f8565772390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.133 7f8565772390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/24/2025 00:47:56.133 7f8565772390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.153 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 03/24/2025 00:47:56.153 7f8565997048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.153 7f8565997048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:56.153 7f8565997048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.234 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 03/24/2025 00:47:56.234 7f85657728d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.234 7f85657728d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/24/2025 00:47:56.235 7f85657728d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.244 7f856f561e88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 03/24/2025 00:47:56.245 7f85657ac6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.245 7f85657ac6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:56.245 7f85657ac6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.247 7f8565772390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 03/24/2025 00:47:56.248 7f85656a62e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.248 7f85656a62e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/24/2025 00:47:56.248 7f85656a62e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.268 7f8565772390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 03/24/2025 00:47:56.268 7f85691c8240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:56.268 7f85691c8240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:56.268 7f85691c8240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.888 7f44aa99be08 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/24/2025 00:48:06.894 7f44aa99be08 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/24/2025 00:48:06.894 7f44aa99be08 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/24/2025 00:48:06.894 7f44aa99be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.23:2181,10.0.0.50:2181,10.0.0.57:2181 03/24/2025 00:48:06.895 7f44aa99be08 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 00:48:06.896 7f44a174feb8 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 03/24/2025 00:48:06.906 7f44a174feb8 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 03/24/2025 00:48:06.907 7f44a1752828 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 03/24/2025 00:48:06.908 7f44a1752828 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 00:48:06.908 7f44a1752828 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/24/2025 00:48:06.908 7f44a1752828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.908 7f44a1752828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 03/24/2025 00:48:06.908 7f44a1752828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.909 7f44a1752828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.909 7f44a1752828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:48:06.909 7f44a1752828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.909 7f44a1752828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.909 7f44a1752828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 03/24/2025 00:48:06.909 7f44a1752828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.919 7f44a1778438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.919 7f44a1778438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:48:06.919 7f44a1778438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:07.002 7f44aa99be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.23:9041', '10.0.0.50:9041', '10.0.0.57:9041'] 03/24/2025 00:48:07.002 7f44aa99be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 03/24/2025 00:48:07.002 7f44aa99be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/24/2025 00:48:07.002 7f44aa99be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/24/2025 00:48:07.003 7f44a0f19cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:07.003 7f44a0f19cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:07.003 7f44a0f19cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:07.004 7f44aa99be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/24/2025 00:48:07.138 7f44aa99be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/24/2025 00:48:07.139 7f44a0f38198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:07.139 7f44a0f38198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:07.139 7f44a0f38198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:07.154 7f44aa99be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/24/2025 00:48:07.154 7f44a5f48588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:07.154 7f44a5f48588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:07.154 7f44a5f48588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:07.160 7f44aa99be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/24/2025 00:48:10.910 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:10.911 7f44a0e25390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:10.911 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:10.911 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:10.912 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:14.914 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:14.916 7f44a0e25390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:14.916 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:14.916 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:14.916 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:14.916 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:14.916 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:14.917 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:14.917 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:14.917 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:14.917 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:14.917 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:14.917 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:14.917 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:18.920 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:18.923 7f44a0e25390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:18.923 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:18.923 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:18.923 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:18.923 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:18.923 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:18.923 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:18.923 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:18.923 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:18.924 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:18.924 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:18.924 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:18.924 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:22.923 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:22.924 7f44a0e25390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:22.924 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:22.925 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:22.926 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:26.927 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:26.928 7f44a0e25390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:26.928 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:26.928 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:26.928 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:26.928 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:26.928 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:26.929 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:26.929 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:26.929 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:26.929 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:26.929 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:26.929 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:26.929 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:30.930 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:30.935 7f44a0e25390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:30.935 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:30.935 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:30.935 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:30.935 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:30.935 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:30.936 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:30.936 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:30.936 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:30.936 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:30.936 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:30.936 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:30.936 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:34.936 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:34.936 7f44a0e25390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:34.937 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:34.938 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:34.938 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:38.941 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:38.947 7f44a0e25390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:38.947 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:38.947 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:38.947 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:38.947 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:38.947 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:38.948 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:38.948 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:38.948 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:38.953 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:38.962 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:38.962 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:38.962 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:42.950 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:42.958 7f44a0e25390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:42.958 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:42.958 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:42.959 7f44a0e25390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:46.959 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:46.960 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:46.960 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:46.960 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:46.960 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:46.960 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:46.961 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:46.961 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:46.961 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:46.961 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:46.961 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:46.961 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:46.961 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:46.961 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:50.964 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:50.969 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:50.970 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:50.970 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:50.970 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:50.970 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:50.970 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:50.970 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:50.970 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:50.971 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:50.971 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:50.971 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:50.971 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:50.971 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:54.974 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:54.975 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:54.976 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:54.977 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:54.977 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:58.978 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:58.979 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:58.979 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:58.979 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:58.980 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:02.981 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:02.982 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:02.982 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:02.982 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:02.982 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:02.983 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:02.983 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:02.983 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:02.983 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:02.983 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:02.983 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:02.983 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:02.983 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:02.983 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:06.982 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:06.984 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:06.984 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:06.984 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:06.984 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:06.984 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:06.984 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:06.984 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:06.985 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:06.985 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:06.985 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:06.985 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:06.985 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:06.985 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:10.986 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:10.988 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:10.988 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:10.988 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:10.988 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:10.988 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:10.988 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:10.988 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:10.988 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:10.989 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:10.989 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:10.989 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:10.989 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:10.989 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:14.990 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:14.992 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:14.993 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:14.993 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:14.993 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:14.993 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:14.993 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:14.994 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:14.994 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:14.994 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:14.994 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:14.994 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:14.994 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:14.994 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:18.995 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:18.996 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:18.996 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:18.996 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:18.997 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:22.998 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:22.999 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:22.999 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:22.999 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:23.000 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:23.000 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:23.000 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:23.000 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:23.000 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:23.000 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:23.000 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:23.000 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:23.001 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:23.001 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:27.001 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:27.003 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:27.003 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:27.003 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:27.003 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:27.003 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:27.003 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:27.004 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:27.004 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:27.004 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:27.004 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:27.004 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:27.004 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:27.004 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:31.007 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:31.008 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:31.009 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:31.010 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:31.010 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:35.012 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:35.013 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:35.013 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:35.013 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:35.013 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:35.013 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:35.013 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:35.013 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:35.013 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:35.014 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:35.014 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:35.014 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:35.014 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:35.014 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:39.014 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:39.015 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:39.015 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:39.015 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:39.016 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:43.019 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:43.021 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:43.021 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:43.021 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:43.021 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:43.021 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:43.021 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:43.021 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:43.022 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:43.022 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:43.022 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:43.022 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:43.022 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:43.022 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:47.023 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:47.024 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:47.025 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:47.025 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:47.025 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:47.025 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:47.025 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:47.026 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:47.026 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:47.028 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:47.028 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:47.028 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:47.029 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:47.029 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:51.027 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:51.028 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:51.029 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:51.030 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:51.030 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:55.030 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:55.032 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:55.032 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:55.032 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:55.032 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:55.032 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:55.032 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:55.033 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:55.033 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:55.033 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:55.033 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:55.033 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:55.033 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:55.033 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:59.034 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:59.035 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:59.035 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:59.035 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:59.036 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:03.036 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:03.037 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:03.037 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:03.037 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:03.037 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:03.038 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:03.038 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:03.038 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:03.038 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:03.038 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:03.038 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:03.038 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:03.038 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:03.038 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:07.040 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:07.042 7f44a0f38b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:07.042 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:07.043 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:07.043 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:07.043 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:07.043 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:07.044 7f44a0f38b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:07.044 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:07.044 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:07.044 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:07.044 7f44a0f38b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:07.044 7f44a0f38b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:07.044 7f44a0f38b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:11.046 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:11.047 7f44a0f3c6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:11.047 7f44a0f3c6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:11.047 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:11.048 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:15.051 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:15.053 7f44a0f3c6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:15.053 7f44a0f3c6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:15.053 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:15.053 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:15.053 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:15.053 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:15.053 7f44a0f3c6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:15.053 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:15.054 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:15.054 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:15.054 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:15.054 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:15.054 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:19.054 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:19.056 7f44a0f3c6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:19.056 7f44a0f3c6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:19.056 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:19.056 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:19.056 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:19.056 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:19.056 7f44a0f3c6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:19.057 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:19.057 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:19.057 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:19.057 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:19.057 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:19.057 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:23.059 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:23.062 7f44a0f3c6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:23.062 7f44a0f3c6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:23.062 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:23.062 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:23.062 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:23.062 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:23.063 7f44a0f3c6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:23.063 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:23.063 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:23.063 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:23.064 7f44a0f3c6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:23.064 7f44a0f3c6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:23.064 7f44a0f3c6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:27.066 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:27.068 7f44a0e7b6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:27.068 7f44a0e7b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:27.068 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:27.068 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:27.068 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:27.068 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:27.069 7f44a0e7b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:27.069 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:27.069 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:27.069 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:27.069 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:27.069 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:27.069 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:31.071 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:31.073 7f44a0e7b6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:31.073 7f44a0e7b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:31.073 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:31.073 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:31.073 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:31.073 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:31.074 7f44a0e7b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:31.074 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:31.074 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:31.074 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:31.074 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:31.074 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:31.074 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:35.074 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:35.075 7f44a0e7b6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:35.075 7f44a0e7b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:35.075 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:35.076 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:39.077 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:39.078 7f44a0e7b6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:39.079 7f44a0e7b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:39.079 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:39.079 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:39.079 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:39.079 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:39.080 7f44a0e7b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:39.080 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:39.080 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:39.080 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:39.080 7f44a0e7b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:39.080 7f44a0e7b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:39.080 7f44a0e7b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:43.082 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:43.084 7f44a472deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:43.084 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:43.084 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:43.084 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:43.084 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:43.084 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:43.085 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:43.085 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:43.085 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:43.085 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:43.085 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:43.085 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:43.085 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:47.086 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:47.087 7f44a472deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:47.087 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:47.087 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:47.088 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:51.092 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:51.093 7f44a472deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:51.093 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:51.093 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:51.093 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:51.093 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:51.093 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:51.094 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:51.094 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:51.094 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:51.094 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:51.094 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:51.094 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:51.094 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:55.097 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:55.098 7f44a472deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:55.098 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:55.098 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:55.098 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:55.098 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:55.098 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:55.099 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:55.099 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:55.099 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:55.099 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:55.099 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:55.099 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:55.099 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:59.100 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:59.101 7f44a472deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:59.101 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:59.101 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:59.101 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:59.101 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:59.101 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:59.101 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:59.101 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:59.101 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:50:59.102 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:59.102 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:59.102 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:59.102 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:03.104 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:03.106 7f44a472deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:51:03.106 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:03.106 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:03.106 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:03.106 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:03.106 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:51:03.107 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:51:03.107 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:03.107 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:03.107 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:03.107 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:03.107 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:51:03.107 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:07.110 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:07.112 7f44a472deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:51:07.112 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:07.112 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:07.112 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:07.112 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:07.112 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:51:07.113 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:51:07.113 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:07.113 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:07.113 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:07.113 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:07.113 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:51:07.113 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:11.112 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:11.113 7f44a472deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:11.114 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:11.115 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:51:11.115 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:15.114 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:15.116 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:15.117 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:15.117 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742777286908422 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.57:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:51:15.117 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:19.118 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:19.120 7f44a472deb8 [contrail-api] [INFO]: Session Event: TCP Connected 03/24/2025 00:51:19.120 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:19.120 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:19.120 7f44a472deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:19.120 7f44a472deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:19.120 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/24/2025 00:51:19.121 7f44a472deb8 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 03/24/2025 00:51:19.121 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/24/2025 00:51:19.121 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 00:51:19.121 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 00:51:19.121 7f44a0e04828 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/24/2025 00:51:19.122 7f44a0e04828 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/24/2025 00:51:28.139 7f44a0eeb6d8 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001016 03/24/2025 00:51:28.139 7f44a0eeb6d8 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/24/2025 00:51:28.140 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/24/2025 00:51:28.140 7f44a472deb8 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 03/24/2025 00:51:28.140 7f44a472deb8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 00:51:28.140 7f44a472deb8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 00:51:28.140 7f44a472deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/24/2025 00:51:28.140 7f44a17ab588 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/24/2025 00:51:28.141 7f44a17ab588 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/24/2025 00:51:41.069 7f44a0eeb6d8 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001297 03/24/2025 00:51:41.070 7f44a0eeb6d8 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/24/2025 00:51:41.070 7f44a472deb8 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/24/2025 00:51:41.070 7f44a472deb8 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 2 03/24/2025 00:51:41.070 7f44a472deb8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 00:51:41.070 7f44a472deb8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map